Jul 29 04:01:41.641503 ip-10-0-129-12 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 29 04:01:41.641518 ip-10-0-129-12 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 29 04:01:41.641528 ip-10-0-129-12 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 29 04:01:41.641861 ip-10-0-129-12 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 29 04:01:53.209376 ip-10-0-129-12 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 29 04:01:53.209395 ip-10-0-129-12 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4acee5e1726d4559b089d81bbc7edb83 --
Jul 29 04:03:29.620015 ip-10-0-129-12 systemd[1]: Starting Kubernetes Kubelet...
Jul 29 04:03:29.959975 ip-10-0-129-12 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:29.959975 ip-10-0-129-12 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 29 04:03:29.959975 ip-10-0-129-12 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:29.959975 ip-10-0-129-12 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 29 04:03:29.959975 ip-10-0-129-12 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 29 04:03:29.960666 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.960592    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 29 04:03:29.964879 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964864    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.964879 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964879    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964883    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964886    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964891    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964894    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964897    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964902    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964906    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964910    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964913    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964916    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964919    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964922    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964925    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964928    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964934    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964937    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964940    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964943    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964946    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.964952 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964948    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964951    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964953    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964956    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964959    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964962    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964964    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964967    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964970    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964972    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964975    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964978    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964980    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964983    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964985    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964988    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964990    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964993    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964995    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.964998    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.965463 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965001    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965004    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965007    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965009    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965011    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965014    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965017    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965019    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965022    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965025    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965027    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965029    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965033    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965036    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965040    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965043    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965046    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965048    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965051    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.965961 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965054    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965056    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965059    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965061    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965064    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965066    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965069    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965071    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965074    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965076    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965079    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965081    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965084    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965086    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965089    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965092    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965094    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965097    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965099    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965102    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.966415 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965104    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965107    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965109    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965112    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965114    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965117    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965119    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965123    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965126    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965128    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965130    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965133    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965135    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965138    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965140    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965143    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965145    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965149    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965152    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.966905 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965829    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965835    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965838    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965841    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965844    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965846    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965851    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965855    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965858    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965861    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965864    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965871    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965875    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965878    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965881    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965884    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965887    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965890    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.967358 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965892    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965896    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965899    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965902    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965905    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965908    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965911    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965914    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965916    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965919    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965922    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965924    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965927    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965929    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965932    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965934    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965937    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965939    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965941    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.967833 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965944    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965947    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965950    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965952    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965955    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965957    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965960    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965963    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965966    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965969    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965972    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965974    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965977    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965979    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965982    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965984    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965987    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965989    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965992    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965994    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.968292 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965997    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.965999    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966002    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966004    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966007    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966009    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966012    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966014    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966017    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966019    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966022    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966025    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966027    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966030    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966033    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966035    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966037    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966041    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966044    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966047    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.968786 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966049    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966052    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966054    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966056    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966059    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966061    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966064    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966067    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966069    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966072    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966074    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966077    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966079    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966082    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966085    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966088    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966090    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966092    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966095    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966097    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.969286 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966100    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966447    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966453    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966455    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966458    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966461    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966464    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966466    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966469    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966471    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966473    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966477    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966480    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966482    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966484    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966487    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966490    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966492    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966495    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966497    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.969784 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966500    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966504    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966508    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966510    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966513    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966516    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966519    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966522    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966524    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966527    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966529    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966531    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966534    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966536    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966539    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966541    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966544    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966546    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966548    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966551    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.970271 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966553    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966556    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966558    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966561    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966564    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966566    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966568    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966571    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966573    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966576    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966583    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966587    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966590    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966593    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966596    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966598    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966601    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966604    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966607    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.970783 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966610    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966612    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966615    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966618    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966620    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966622    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966625    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966628    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966630    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966633    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966635    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966638    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966640    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966643    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966645    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966648    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966651    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966653    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966656    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966658    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.971241 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966661    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966663    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966666    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966670    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966672    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966675    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966677    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966680    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966682    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966685    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966687    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966690    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966693    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966695    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966698    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966701    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966703    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966706    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966710    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966713    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.971736 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.966716    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966803    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966810    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966817    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966821    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966825    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966828    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966832    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966836    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966839    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966842    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966846    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966849    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966852    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966855    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966859    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966863    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966865    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966868    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966872    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966875    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966878    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966881    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966885    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 29 04:03:29.972269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966889    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966904    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966909    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966913    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966916    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966919    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966922    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966925    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966928    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966932    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966935    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966938    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966940    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966943    2578 flags.go:64] FLAG: --enable-server="true"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966946    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966951    2578 flags.go:64] FLAG: --event-burst="100"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966954    2578 flags.go:64] FLAG: --event-qps="50"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966957    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966959    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966962    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966967    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966970    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966973    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966977    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966980    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 29 04:03:29.972850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966983    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966986    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966989    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966991    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966994    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.966997    2578 flags.go:64] FLAG: --feature-gates=""
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967002    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967005    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967008    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967011    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967014    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967017    2578 flags.go:64] FLAG: --help="false"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967020    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-12.ec2.internal"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967023    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967026    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967028    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967032    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967035    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967038    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967040    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967043    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967046    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967048    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967051    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 29 04:03:29.973637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967054    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967057    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967059    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967062    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967065    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967068    2578 flags.go:64] FLAG: --lock-file=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967072    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967075    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967078    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967082    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967085    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967088    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967091    2578 flags.go:64] FLAG: --logging-format="text"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967093    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967098    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967100    2578 flags.go:64] FLAG: --manifest-url=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967103    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967107    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967110    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967113    2578 flags.go:64] FLAG: --max-pods="110"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967116    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967119    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967122    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967125    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967128    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 29 04:03:29.974669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967131    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967133    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967140    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967143    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967146    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967149    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967152    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967156    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967159    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967162    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967165    2578 flags.go:64] FLAG: --port="10250"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967168    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967171    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-08dbd56d466121aa0"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967174    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967180    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967183    2578 flags.go:64] FLAG: --register-node="true"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967186    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967190    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967193    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967195    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967198    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967203    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967206    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967209    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967212    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 29 04:03:29.975759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967215    2578 flags.go:64] FLAG: --runonce="false"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967218    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967221    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967224    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967227    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967230    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967233    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967236    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967239    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967242    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967244    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967247    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967250    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967253    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967256    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967258    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967264    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967266    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967269    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967272    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967276    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967280    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967282    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967285    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967288    2578 flags.go:64] FLAG: --v="2"
Jul 29 04:03:29.976919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967292    2578 flags.go:64] FLAG: --version="false"
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967296    2578 flags.go:64] FLAG: --vmodule=""
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967299    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.967304    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967424    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967429    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967432    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967435    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967438    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967441    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967444    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967447    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967450    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967453    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967455    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967458    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967462    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967465    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967468    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967470    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967473    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.977719 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967475    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967478    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967480    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967483    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967485    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967488    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967491    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967494    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967497    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967499    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967501    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967504    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967508    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967511    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967515    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967518    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967521    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967524    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967527    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.978517 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967530    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967532    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967535    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967537    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967540    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967543    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967545    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967548    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967551    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967554    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967557    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967560    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967562    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967565    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967568    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967570    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967573    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967575    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967577    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967580    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.979380 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967583    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967586    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967589    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967591    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967594    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967596    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967599    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967602    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967605    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967608    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967611    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967613    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967616    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967618    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967621    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967623    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967626    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967628    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967631    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967633    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.979954 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967636    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967638    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967640    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967643    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967645    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967648    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967650    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967654    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967657    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967661    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967664    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967666    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967669    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967672    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967674    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967677    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967679    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967682    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967684    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967688    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.980532 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967690    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967693    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.967695    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.968277    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.975708    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.975726    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.975765    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.975774    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975860    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975868    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975873    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975878    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975882    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975887    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975893    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.981054 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975897    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975902    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975906    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975910    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975915    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975919    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975924    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975928    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975937    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975942    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975946    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975952    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975958    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975963    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975968    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975973    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975978    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975982    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.981468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975986    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975990    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.975995    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976007    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976012    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976017    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976021    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976025    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976029    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976033    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976038    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976042    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976046    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976050    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976054    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976061    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976066    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976071    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976075    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.981945 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976080    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976084    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976088    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976093    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976097    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976102    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976106    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976111    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976117    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976123    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976127    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976132    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976136    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976140    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976144    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976148    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976152    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976158    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976162    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.982523 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976167    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976171    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976175    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976179    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976183    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976188    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976192    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976196    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976201    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976205    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976209    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976214    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976219    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976223    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976227    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976231    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976236    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976240    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976244    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976248    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.983041 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976252    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976257    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976261    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976265    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976269    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976274    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976278    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976282    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976286    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976290    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976294    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976299    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976304    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976308    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976312    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.983570 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.976320    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976535    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976544    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976548    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976553    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976558    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976565    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976571    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976576    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976580    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976585    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976590    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976595    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976600    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976604    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976608    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976612    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976617    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976621    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 29 04:03:29.984226 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976625    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976629    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976633    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976637    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976641    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976646    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976650    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976654    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976658    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976662    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976674    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976678    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976683    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976687    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976691    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976695    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976699    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976703    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976708    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976712    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 29 04:03:29.984804 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976716    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976720    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976726    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976731    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976736    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976741    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976762    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976766    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976770    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976775    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976779    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976783    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976787    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976791    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976796    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976799    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976803    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976808    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976812    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 29 04:03:29.985287 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976816    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976820    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976827    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976832    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976849    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976855    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976859    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976863    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976867    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976871    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976875    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976879    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976883    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976888    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976892    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976896    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976901    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976905    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976911    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 29 04:03:29.985726 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976915    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976919    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976923    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976927    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976931    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976935    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976939    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976942    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976947    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976951    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976955    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976959    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976963    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976967    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976971    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976975    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976980    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976984    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.976998    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.977003    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 29 04:03:29.986244 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.977007    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.977011    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:29.977015    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.977024    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.977224    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.979967    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.981289    2578 server.go:1019] "Starting client certificate rotation"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.981403    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.981464    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.984709    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 04:03:29.986716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:29.986098    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 29 04:03:30.001548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.001529    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 29 04:03:30.004592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.004578    2578 log.go:25] "Validated CRI v1 image API"
Jul 29 04:03:30.005512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.005491    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 29 04:03:30.007531 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.007512    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 bb5f08d2-8241-40c2-b0c2-9581f8a63603:/dev/nvme0n1p3 fb2a6a1d-248b-4556-bcff-223427408d1b:/dev/nvme0n1p4]
Jul 29 04:03:30.007606 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.007529    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 29 04:03:30.010598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.010580    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 04:03:30.012679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.012572    2578 manager.go:216] Machine: {Timestamp:2026-07-29 04:03:30.01136114 +0000 UTC m=+0.286377923 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102370 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ed8cfcbeaa2c7e6be2e1078d24fd2 SystemUUID:ec2ed8cf-cbea-a2c7-e6be-2e1078d24fd2 BootID:4acee5e1-726d-4559-b089-d81bbc7edb83 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:20:71:91:47:a5 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:20:71:91:47:a5 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e2:a9:3c:26:4c:a6 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 29 04:03:30.012679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.012675    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 29 04:03:30.012796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.012759    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 29 04:03:30.015403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.015381    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 29 04:03:30.015527 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.015406    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-12.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 29 04:03:30.016113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.016102    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 29 04:03:30.016155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.016114    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 29 04:03:30.016155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.016122    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 04:03:30.017172 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.017161    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 29 04:03:30.018233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.018222    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 29 04:03:30.019854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.019844    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 04:03:30.019973 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.019964    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 29 04:03:30.020005 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.019995    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 29 04:03:30.020032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020008    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 29 04:03:30.020032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020022    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 29 04:03:30.020032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020030    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 29 04:03:30.020113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020039    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 29 04:03:30.020364 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020353    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 04:03:30.020410 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.020371    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 29 04:03:30.022202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.022184    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 29 04:03:30.024373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.024360    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 29 04:03:30.024430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.024390    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 29 04:03:30.026004 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.025992    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026010    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026016    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026021    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026030    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026035    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 29 04:03:30.026045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026043    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026049    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026057    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026064    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026080    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026086    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026109    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 29 04:03:30.026214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.026115    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 29 04:03:30.029175 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.029163    2578 server.go:1268] "Started kubelet"
Jul 29 04:03:30.029284 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.029239    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 29 04:03:30.029338 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.029302    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 29 04:03:30.029338 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.029298    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 29 04:03:30.029988 ip-10-0-129-12 systemd[1]: Started Kubernetes Kubelet.
Jul 29 04:03:30.034858 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.034724    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 29 04:03:30.034926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.034844    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 29 04:03:30.034926 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.034900    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 29 04:03:30.035064 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.035002    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-12.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 29 04:03:30.037108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.036919    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 29 04:03:30.038616 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.038597    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 29 04:03:30.040009 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.039163    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c6a6e63911d79e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-29 04:03:30.02913987 +0000 UTC m=+0.304156649,LastTimestamp:2026-07-29 04:03:30.02913987 +0000 UTC m=+0.304156649,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 29 04:03:30.043821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.043808    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 29 04:03:30.043821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.043813    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 29 04:03:30.043934 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.043860    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.044360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044272    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 29 04:03:30.044360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044274    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 29 04:03:30.044360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044304    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 29 04:03:30.044529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044390    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 29 04:03:30.044529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044398    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 29 04:03:30.044601 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044539    2578 factory.go:55] Registering systemd factory
Jul 29 04:03:30.044601 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044552    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 29 04:03:30.044793 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044776    2578 factory.go:153] Registering CRI-O factory
Jul 29 04:03:30.044793 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044791    2578 factory.go:223] Registration of the crio container factory successfully
Jul 29 04:03:30.044909 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044842    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 29 04:03:30.044909 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044865    2578 factory.go:103] Registering Raw factory
Jul 29 04:03:30.044909 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.044879    2578 manager.go:1196] Started watching for new ooms in manager
Jul 29 04:03:30.045311 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.045297    2578 manager.go:349] Starting recovery of all containers
Jul 29 04:03:30.045912 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.045892    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 29 04:03:30.046003 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.045967    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-12.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 29 04:03:30.056289 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.056276    2578 manager.go:354] Recovery completed
Jul 29 04:03:30.060449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.060434    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.062130 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062101    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.062192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062144    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.062192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062158    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.062658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062640    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 29 04:03:30.062658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062655    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.062814 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062656    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 29 04:03:30.062814 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.062742    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 29 04:03:30.063334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.063317    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.063400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.063355    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.063400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.063369    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.064406 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.064392    2578 policy_none.go:49] "None policy: Start"
Jul 29 04:03:30.064469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.064410    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 29 04:03:30.064469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.064422    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 29 04:03:30.065375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.065364    2578 policy_none.go:47] "Start"
Jul 29 04:03:30.065548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.065531    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmtrk"
Jul 29 04:03:30.070914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.070890    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xmtrk"
Jul 29 04:03:30.076621 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.075161    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-12.ec2.internal.18c6a6e63b093d12  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-12.ec2.internal,UID:ip-10-0-129-12.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-12.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-12.ec2.internal,},FirstTimestamp:2026-07-29 04:03:30.06213045 +0000 UTC m=+0.337147234,LastTimestamp:2026-07-29 04:03:30.06213045 +0000 UTC m=+0.337147234,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-12.ec2.internal,}"
Jul 29 04:03:30.095421 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095407    2578 manager.go:337] "Starting Device Plugin manager"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.095433    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095443    2578 server.go:87] "Starting device plugin registration server"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095664    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095673    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095790    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095874    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.095884    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.096408    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 29 04:03:30.103377 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.096457    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.187706 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.187682    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 29 04:03:30.188853 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.188838    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 29 04:03:30.188931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.188872    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 29 04:03:30.188931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.188888    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 29 04:03:30.188931 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.188920    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 29 04:03:30.191351 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.191328    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:30.196084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.196070    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.196785 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.196771    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.196858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.196795    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.196858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.196805    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.196858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.196825    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.206671 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.206648    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.206671 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.206666    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-12.ec2.internal\": node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.230534 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.230495    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.289636 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.289509    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"]
Jul 29 04:03:30.289761 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.289681    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.290958 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.290945    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.291013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.290969    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.291013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.290981    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.292178 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292166    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.292333 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292320    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.292391 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292347    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.292827 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292811    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.292895 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292816    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.292895 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292863    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.292895 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292874    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.292895 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292842    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.293032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.292919    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.293854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.293839    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.293896 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.293865    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:30.294455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.294442    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:30.294510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.294466    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:30.294510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.294480    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:30.324365 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.324344    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.328644 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.328629    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-12.ec2.internal\" not found" node="ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.331237 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.331224    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.345811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.345788    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.345897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.345816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.345897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.345838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834222b015f197bd5eefa17c25b1b6b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"834222b015f197bd5eefa17c25b1b6b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.431606 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.431588    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.446972 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.446951    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.447037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.446976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834222b015f197bd5eefa17c25b1b6b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"834222b015f197bd5eefa17c25b1b6b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.447037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.446993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.447037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.447027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.447161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.447057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/834222b015f197bd5eefa17c25b1b6b0-config\") pod \"kube-apiserver-proxy-ip-10-0-129-12.ec2.internal\" (UID: \"834222b015f197bd5eefa17c25b1b6b0\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.447161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.447075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/46ac9f45112ada261e00ec4f0b28a26a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal\" (UID: \"46ac9f45112ada261e00ec4f0b28a26a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.532326 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.532309    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.627836 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.627796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.632635 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.632619    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.632697 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.632648    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:30.733600 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.733574    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.834095 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.834036    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.918647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.918620    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:30.934979 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:30.934960    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:30.980492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.980464    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 29 04:03:30.980925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.980570    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 04:03:30.980925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:30.980610    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 29 04:03:31.035880 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:31.035854    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:31.077571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.077533    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-28 03:58:31 +0000 UTC" deadline="2028-01-08 14:35:59.892344973 +0000 UTC"
Jul 29 04:03:31.077571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.077570    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12682h32m28.81477934s"
Jul 29 04:03:31.129942 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:31.129917    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46ac9f45112ada261e00ec4f0b28a26a.slice/crio-71fc76d3ce5d1700fb4528237c23bc658367f2ce98c1702b3ea3b03a4981de8b WatchSource:0}: Error finding container 71fc76d3ce5d1700fb4528237c23bc658367f2ce98c1702b3ea3b03a4981de8b: Status 404 returned error can't find the container with id 71fc76d3ce5d1700fb4528237c23bc658367f2ce98c1702b3ea3b03a4981de8b
Jul 29 04:03:31.130482 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:31.130459    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod834222b015f197bd5eefa17c25b1b6b0.slice/crio-32574db573e4c3ae216ff55de9fd8132fdb129701e37d9472c37cd656cee0292 WatchSource:0}: Error finding container 32574db573e4c3ae216ff55de9fd8132fdb129701e37d9472c37cd656cee0292: Status 404 returned error can't find the container with id 32574db573e4c3ae216ff55de9fd8132fdb129701e37d9472c37cd656cee0292
Jul 29 04:03:31.134224 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.134210    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:03:31.136966 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:31.136952    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:31.193458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.193421    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"834222b015f197bd5eefa17c25b1b6b0","Type":"ContainerStarted","Data":"32574db573e4c3ae216ff55de9fd8132fdb129701e37d9472c37cd656cee0292"}
Jul 29 04:03:31.194696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.194670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"46ac9f45112ada261e00ec4f0b28a26a","Type":"ContainerStarted","Data":"71fc76d3ce5d1700fb4528237c23bc658367f2ce98c1702b3ea3b03a4981de8b"}
Jul 29 04:03:31.220128 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.220109    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:31.225445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.225429    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 29 04:03:31.226450 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.226429    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientMemory"
Jul 29 04:03:31.226530 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.226463    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasNoDiskPressure"
Jul 29 04:03:31.226530 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.226476    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeHasSufficientPID"
Jul 29 04:03:31.237939 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:31.237924    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:31.344785 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:31.344765    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:31.445219 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:31.445168    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-12.ec2.internal\" not found"
Jul 29 04:03:31.523100 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.523075    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:31.544162 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.544139    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:31.557393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.557373    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 04:03:31.558515 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.558496    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal"
Jul 29 04:03:31.567129 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:31.567111    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 29 04:03:32.020946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.020918    2578 apiserver.go:52] "Watching apiserver"
Jul 29 04:03:32.035166 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.035136    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 29 04:03:32.037127 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.037101    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal","openshift-multus/multus-c7zj9","openshift-multus/network-metrics-daemon-qg8fx","kube-system/konnectivity-agent-4465m","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5","openshift-dns/node-resolver-hsqxh","openshift-image-registry/node-ca-tvxfx","openshift-multus/multus-additional-cni-plugins-j5lf5","openshift-network-diagnostics/network-check-target-mzg2n","openshift-network-operator/iptables-alerter-pb2cf","openshift-ovn-kubernetes/ovnkube-node-hjrt5","kube-system/global-pull-secret-syncer-97qpv","kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal","openshift-cluster-node-tuning-operator/tuned-xxxcs"]
Jul 29 04:03:32.038913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.038888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.040292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.040263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.042242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.042226    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.042342 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.042301    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:32.042911 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.042889    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.043006 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.042916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 29 04:03:32.043267 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.043247    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.043497 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.043479    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-5vddp\""
Jul 29 04:03:32.043641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.043622    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.043712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.043691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.043877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.043861    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.044321 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.044294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 29 04:03:32.044420 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.044381    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ctd6g\""
Jul 29 04:03:32.044577 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.044544    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 29 04:03:32.044759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.044742    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 29 04:03:32.044956 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.044939    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 29 04:03:32.045135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.045118    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 29 04:03:32.046102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.046082    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.046623 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.046559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.048974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.048956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:32.049076 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.049015    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:32.049640 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.049618    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.049726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.049653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 29 04:03:32.049726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.049720    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-dvm5p\""
Jul 29 04:03:32.049877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.049861    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.049936 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.049914    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.050135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050116    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-nc5xd\""
Jul 29 04:03:32.050135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050131    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 29 04:03:32.050273 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050249    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.050788 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050449    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-998k7\""
Jul 29 04:03:32.050788 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050653    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 29 04:03:32.050974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.050815    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.052772 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.052204    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.054480 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.054365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.055683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.055496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.055683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.055511    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 29 04:03:32.055683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.055583    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.056921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-bin\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.056968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-konnectivity-ca\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057008    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-kubelet\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-log-socket\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-socket-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-device-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057164    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-netd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-config\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057315    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8wvxr\" (UniqueName: \"kubernetes.io/projected/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-kube-api-access-8wvxr\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.057359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1915d-3c73-4d25-b427-e119aecaa5b0-serviceca\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-var-lib-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-node-log\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1915d-3c73-4d25-b427-e119aecaa5b0-host\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057617    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgl22\" (UniqueName: \"kubernetes.io/projected/fed1915d-3c73-4d25-b427-e119aecaa5b0-kube-api-access-pgl22\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-netns\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-etc-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.058102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.057745    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-env-overrides\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.060534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.058965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.060534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.059180    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 29 04:03:32.060534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.059411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpn6n\" (UniqueName: \"kubernetes.io/projected/71cca990-0ce8-4bd7-9434-04d6a806c4a4-kube-api-access-rpn6n\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.060534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.060190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.060888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.060870    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.060989 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.060968    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:32.061152 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061130    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5rtzq\""
Jul 29 04:03:32.061223 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061209    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:03:32.061334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061253    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-6887w\""
Jul 29 04:03:32.061724 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 29 04:03:32.061724 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061335    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 29 04:03:32.061724 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.061631    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-zvr6g\""
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062188    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-hosts-file\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062437    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-script-lib\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-agent-certs\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-systemd-units\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-ovn\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.062655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gn98x\" (UniqueName: \"kubernetes.io/projected/c1759f39-c5c2-4798-a020-b3585fe0867e-kube-api-access-gn98x\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-sys-fs\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063278    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-registration-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063301    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063325    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ff4z\" (UniqueName: \"kubernetes.io/projected/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kube-api-access-2ff4z\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-tmp-dir\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-slash\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.063558 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.063400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-systemd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.065736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.064063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 29 04:03:32.065736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.064430    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 29 04:03:32.068168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.068148    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-l9hbz\""
Jul 29 04:03:32.068420 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.068391    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 29 04:03:32.081672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.081645    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5d6k"
Jul 29 04:03:32.089253 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.089236    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-b5d6k"
Jul 29 04:03:32.145424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.145407    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 29 04:03:32.163572 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b72840df-ea6d-414d-b110-0bc7e3cd91d1-iptables-alerter-script\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.163667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163583    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd4cb\" (UniqueName: \"kubernetes.io/projected/b72840df-ea6d-414d-b110-0bc7e3cd91d1-kube-api-access-nd4cb\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.163667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgzwb\" (UniqueName: \"kubernetes.io/projected/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-kube-api-access-qgzwb\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.163667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-slash\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.163667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-systemd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-bin\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-konnectivity-ca\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-kubernetes\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-os-release\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-systemd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-bin\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.163885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163843    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-slash\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-sys\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-lib-modules\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163972    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-system-cni-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.163998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-netd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-netns\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-cni-netd\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164125    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-modprobe-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-conf-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164174    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ffg52\" (UniqueName: \"kubernetes.io/projected/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-kube-api-access-ffg52\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1915d-3c73-4d25-b427-e119aecaa5b0-host\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-etc-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-hosts-file\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-hostroot\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164332    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-daemon-config\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164340    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-etc-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-konnectivity-ca\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-systemd-units\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164400    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fed1915d-3c73-4d25-b427-e119aecaa5b0-host\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-ovn\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-hosts-file\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-sys-fs\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.164722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164517    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-run-ovn\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-kubelet\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-sys-fs\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-multus-certs\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164581    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-systemd-units\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.164592    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cnibin\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.164662    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:03:32.664641095 +0000 UTC m=+2.939657873 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-registration-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164752    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-tmp-dir\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-registration-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysconfig\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-etc-selinux\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-conf\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.165598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-tmp\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85c9\" (UniqueName: \"kubernetes.io/projected/0c15446a-a3ba-49c2-8326-54de154abbe5-kube-api-access-s85c9\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-var-lib-kubelet\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-system-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.164991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cnibin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-os-release\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-bin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165046    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-multus\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165091    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-tmp-dir\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-etc-kubernetes\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-kubelet\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-log-socket\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165212    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-kubelet\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-socket-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-log-socket\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165263    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-device-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.166471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-device-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-config\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8wvxr\" (UniqueName: \"kubernetes.io/projected/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-kube-api-access-8wvxr\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165369    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/cd3ca4b7-2d17-4dea-af34-a7047a72126e-socket-dir\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-socket-dir-parent\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165560    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-dbus\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1915d-3c73-4d25-b427-e119aecaa5b0-serviceca\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-var-lib-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-var-lib-openvswitch\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-node-log\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165741    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cni-binary-copy\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-k8s-cni-cncf-io\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.167355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165797    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-node-log\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgl22\" (UniqueName: \"kubernetes.io/projected/fed1915d-3c73-4d25-b427-e119aecaa5b0-kube-api-access-pgl22\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-netns\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-env-overrides\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpn6n\" (UniqueName: \"kubernetes.io/projected/71cca990-0ce8-4bd7-9434-04d6a806c4a4-kube-api-access-rpn6n\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-script-lib\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-agent-certs\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.165986    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-config\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-tuned\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gn98x\" (UniqueName: \"kubernetes.io/projected/c1759f39-c5c2-4798-a020-b3585fe0867e-kube-api-access-gn98x\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166065    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166101    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/fed1915d-3c73-4d25-b427-e119aecaa5b0-serviceca\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-systemd\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-host\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71cca990-0ce8-4bd7-9434-04d6a806c4a4-host-run-netns\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.168241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166175    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b72840df-ea6d-414d-b110-0bc7e3cd91d1-host-slash\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.169084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-kubelet-config\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.169084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ff4z\" (UniqueName: \"kubernetes.io/projected/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kube-api-access-2ff4z\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.169084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-run\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.169084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-env-overrides\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.169084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.166582    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovnkube-script-lib\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.169340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.169185    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71cca990-0ce8-4bd7-9434-04d6a806c4a4-ovn-node-metrics-cert\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.169879 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.169857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/cb651ea7-f8e5-4090-a7d7-d369a789d9e8-agent-certs\") pod \"konnectivity-agent-4465m\" (UID: \"cb651ea7-f8e5-4090-a7d7-d369a789d9e8\") " pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.176246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.176224    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8wvxr\" (UniqueName: \"kubernetes.io/projected/e8adbb30-a0d1-4caa-a2d6-1dde5d6de217-kube-api-access-8wvxr\") pod \"node-resolver-hsqxh\" (UID: \"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217\") " pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.177888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.177385    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpn6n\" (UniqueName: \"kubernetes.io/projected/71cca990-0ce8-4bd7-9434-04d6a806c4a4-kube-api-access-rpn6n\") pod \"ovnkube-node-hjrt5\" (UID: \"71cca990-0ce8-4bd7-9434-04d6a806c4a4\") " pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.178299 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.178132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ff4z\" (UniqueName: \"kubernetes.io/projected/cd3ca4b7-2d17-4dea-af34-a7047a72126e-kube-api-access-2ff4z\") pod \"aws-ebs-csi-driver-node-tnvz5\" (UID: \"cd3ca4b7-2d17-4dea-af34-a7047a72126e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.179027 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.179003    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgl22\" (UniqueName: \"kubernetes.io/projected/fed1915d-3c73-4d25-b427-e119aecaa5b0-kube-api-access-pgl22\") pod \"node-ca-tvxfx\" (UID: \"fed1915d-3c73-4d25-b427-e119aecaa5b0\") " pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.179122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.179070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gn98x\" (UniqueName: \"kubernetes.io/projected/c1759f39-c5c2-4798-a020-b3585fe0867e-kube-api-access-gn98x\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.266939 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.266900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-kubelet\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.266948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-multus-certs\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.266974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cnibin\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysconfig\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-kubelet\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-conf\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cnibin\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-tmp\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-multus-certs\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85c9\" (UniqueName: \"kubernetes.io/projected/0c15446a-a3ba-49c2-8326-54de154abbe5-kube-api-access-s85c9\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysconfig\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-conf\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-var-lib-kubelet\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267222    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-var-lib-kubelet\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267316    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-system-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cnibin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-os-release\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-bin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267415    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-multus\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267412    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-system-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cnibin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-etc-kubernetes\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-bin\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-etc-kubernetes\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267551    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-var-lib-cni-multus\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-os-release\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-socket-dir-parent\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-dbus\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cni-binary-copy\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-k8s-cni-cncf-io\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-tuned\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.267940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.267882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.267952    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.268007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:32.767989644 +0000 UTC m=+3.043006416 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268029    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-cni-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268075    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-dbus\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268139    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-socket-dir-parent\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-systemd\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-host\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b72840df-ea6d-414d-b110-0bc7e3cd91d1-host-slash\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268241    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-kubelet-config\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268294    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/99b6074b-caea-4900-9ce6-34596a3df637-kubelet-config\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268300    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-run\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b72840df-ea6d-414d-b110-0bc7e3cd91d1-iptables-alerter-script\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd4cb\" (UniqueName: \"kubernetes.io/projected/b72840df-ea6d-414d-b110-0bc7e3cd91d1-kube-api-access-nd4cb\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268388    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-sysctl-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgzwb\" (UniqueName: \"kubernetes.io/projected/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-kube-api-access-qgzwb\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.268571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268425    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-kubernetes\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-os-release\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-sys\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268498    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-cni-binary-copy\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-lib-modules\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-system-cni-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-k8s-cni-cncf-io\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-netns\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-run\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268645    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-modprobe-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-conf-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268697    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ffg52\" (UniqueName: \"kubernetes.io/projected/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-kube-api-access-ffg52\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-hostroot\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-daemon-config\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268857    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-lib-modules\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268931    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-systemd\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.269400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.268983    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-host\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269022    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b72840df-ea6d-414d-b110-0bc7e3cd91d1-host-slash\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-kubernetes\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-os-release\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-sys\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269260    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b72840df-ea6d-414d-b110-0bc7e3cd91d1-iptables-alerter-script\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269263    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-daemon-config\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269314    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-host-run-netns\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269350    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-tuning-conf-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269361    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-system-cni-dir\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-modprobe-d\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269474    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-hostroot\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-multus-conf-dir\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.269914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-cni-binary-copy\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.270471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.270466    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-tmp\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.271328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.271001    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c15446a-a3ba-49c2-8326-54de154abbe5-etc-tuned\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.274108 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.274086    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:32.274223 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.274113    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:32.274223 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.274128    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:32.274223 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.274190    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:32.774172103 +0000 UTC m=+3.049188871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:32.275421 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.275396    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85c9\" (UniqueName: \"kubernetes.io/projected/0c15446a-a3ba-49c2-8326-54de154abbe5-kube-api-access-s85c9\") pod \"tuned-xxxcs\" (UID: \"0c15446a-a3ba-49c2-8326-54de154abbe5\") " pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.281317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.281290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd4cb\" (UniqueName: \"kubernetes.io/projected/b72840df-ea6d-414d-b110-0bc7e3cd91d1-kube-api-access-nd4cb\") pod \"iptables-alerter-pb2cf\" (UID: \"b72840df-ea6d-414d-b110-0bc7e3cd91d1\") " pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.281935 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.281593    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgzwb\" (UniqueName: \"kubernetes.io/projected/6b7af58c-724c-4b51-b2a6-df5a3ab4ba98-kube-api-access-qgzwb\") pod \"multus-additional-cni-plugins-j5lf5\" (UID: \"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98\") " pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.281935 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.281887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ffg52\" (UniqueName: \"kubernetes.io/projected/d8f66f9b-007e-4c36-b24c-29a9a1b67cff-kube-api-access-ffg52\") pod \"multus-c7zj9\" (UID: \"d8f66f9b-007e-4c36-b24c-29a9a1b67cff\") " pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.361256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.361225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-tvxfx"
Jul 29 04:03:32.372269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.372248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:32.384138 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.384116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:32.388967 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.388945    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5"
Jul 29 04:03:32.397800 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.397779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hsqxh"
Jul 29 04:03:32.405610 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.405590    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-xxxcs"
Jul 29 04:03:32.413685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.413667    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-c7zj9"
Jul 29 04:03:32.419860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.419841    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:32.422841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.422811    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-pb2cf"
Jul 29 04:03:32.430525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.430506    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-j5lf5"
Jul 29 04:03:32.670886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.670794    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:32.671056 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.670977    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:32.671056 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.671054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:03:33.671035877 +0000 UTC m=+3.946052653 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:32.715542 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:32.715514    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfed1915d_3c73_4d25_b427_e119aecaa5b0.slice/crio-d1a65cb37ac10b03e4de08bdee5ac468040dfbedabb11ad8241322282ebe6778 WatchSource:0}: Error finding container d1a65cb37ac10b03e4de08bdee5ac468040dfbedabb11ad8241322282ebe6778: Status 404 returned error can't find the container with id d1a65cb37ac10b03e4de08bdee5ac468040dfbedabb11ad8241322282ebe6778
Jul 29 04:03:32.771557 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.771526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:32.771704 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.771642    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:32.771772 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.771719    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:33.771698589 +0000 UTC m=+4.046715375 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:32.872564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:32.872534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:32.872742 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.872721    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:32.872820 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.872765    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:32.872820 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.872781    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:32.872945 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:32.872849    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:33.872827265 +0000 UTC m=+4.147844050 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:33.066883 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.066851    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c15446a_a3ba_49c2_8326_54de154abbe5.slice/crio-da7902f8171174939a9f3530ca757e06adb21ff68af4c19a3ea4089f2fc083dc WatchSource:0}: Error finding container da7902f8171174939a9f3530ca757e06adb21ff68af4c19a3ea4089f2fc083dc: Status 404 returned error can't find the container with id da7902f8171174939a9f3530ca757e06adb21ff68af4c19a3ea4089f2fc083dc
Jul 29 04:03:33.086084 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.086057    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd3ca4b7_2d17_4dea_af34_a7047a72126e.slice/crio-2930b261a938d247ece22e0374058af888621e397f202a7ffb418560c4ebd635 WatchSource:0}: Error finding container 2930b261a938d247ece22e0374058af888621e397f202a7ffb418560c4ebd635: Status 404 returned error can't find the container with id 2930b261a938d247ece22e0374058af888621e397f202a7ffb418560c4ebd635
Jul 29 04:03:33.090021 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.089992    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb72840df_ea6d_414d_b110_0bc7e3cd91d1.slice/crio-cf139d964deddebdbecb22ec6bf00afefb8aff659bda7f777f1719191a4dba13 WatchSource:0}: Error finding container cf139d964deddebdbecb22ec6bf00afefb8aff659bda7f777f1719191a4dba13: Status 404 returned error can't find the container with id cf139d964deddebdbecb22ec6bf00afefb8aff659bda7f777f1719191a4dba13
Jul 29 04:03:33.091293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.091267    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:58:32 +0000 UTC" deadline="2028-04-27 09:19:47.05429442 +0000 UTC"
Jul 29 04:03:33.091371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.091293    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15317h16m13.963004319s"
Jul 29 04:03:33.096598 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.096575    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8adbb30_a0d1_4caa_a2d6_1dde5d6de217.slice/crio-5bdd3a09cef1b854e92a591a3c8efd3b368087ea44fa28b981f1537f876e5c61 WatchSource:0}: Error finding container 5bdd3a09cef1b854e92a591a3c8efd3b368087ea44fa28b981f1537f876e5c61: Status 404 returned error can't find the container with id 5bdd3a09cef1b854e92a591a3c8efd3b368087ea44fa28b981f1537f876e5c61
Jul 29 04:03:33.097503 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.097479    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8f66f9b_007e_4c36_b24c_29a9a1b67cff.slice/crio-3d1e184fad99f1d6ce9ab4f0add704f8c92c0b3026f5b1606c7c8733e230db1d WatchSource:0}: Error finding container 3d1e184fad99f1d6ce9ab4f0add704f8c92c0b3026f5b1606c7c8733e230db1d: Status 404 returned error can't find the container with id 3d1e184fad99f1d6ce9ab4f0add704f8c92c0b3026f5b1606c7c8733e230db1d
Jul 29 04:03:33.098569 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.098463    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71cca990_0ce8_4bd7_9434_04d6a806c4a4.slice/crio-d621ffb53e91d4c942fcc75e420f6ba9e4f4317c3603f66bb9561281095345d6 WatchSource:0}: Error finding container d621ffb53e91d4c942fcc75e420f6ba9e4f4317c3603f66bb9561281095345d6: Status 404 returned error can't find the container with id d621ffb53e91d4c942fcc75e420f6ba9e4f4317c3603f66bb9561281095345d6
Jul 29 04:03:33.099994 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.099960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb651ea7_f8e5_4090_a7d7_d369a789d9e8.slice/crio-8f23ece6bf59e2f152e1ded2aefb45dfd471855214ac56f3d61772aabadfdb17 WatchSource:0}: Error finding container 8f23ece6bf59e2f152e1ded2aefb45dfd471855214ac56f3d61772aabadfdb17: Status 404 returned error can't find the container with id 8f23ece6bf59e2f152e1ded2aefb45dfd471855214ac56f3d61772aabadfdb17
Jul 29 04:03:33.102781 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:03:33.102143    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b7af58c_724c_4b51_b2a6_df5a3ab4ba98.slice/crio-ee3b5a14a832e5a622852c231e6ba162cbf9f8355db492ead0dcc9ecd1dee0fa WatchSource:0}: Error finding container ee3b5a14a832e5a622852c231e6ba162cbf9f8355db492ead0dcc9ecd1dee0fa: Status 404 returned error can't find the container with id ee3b5a14a832e5a622852c231e6ba162cbf9f8355db492ead0dcc9ecd1dee0fa
Jul 29 04:03:33.199678 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.199644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" event={"ID":"834222b015f197bd5eefa17c25b1b6b0","Type":"ContainerStarted","Data":"d621a7208705f03706a3f1d6ac30ff04cb45f44e4e5f7b3c190c2f3c49a380d2"}
Jul 29 04:03:33.203664 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.203629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4465m" event={"ID":"cb651ea7-f8e5-4090-a7d7-d369a789d9e8","Type":"ContainerStarted","Data":"8f23ece6bf59e2f152e1ded2aefb45dfd471855214ac56f3d61772aabadfdb17"}
Jul 29 04:03:33.204932 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.204908    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c7zj9" event={"ID":"d8f66f9b-007e-4c36-b24c-29a9a1b67cff","Type":"ContainerStarted","Data":"3d1e184fad99f1d6ce9ab4f0add704f8c92c0b3026f5b1606c7c8733e230db1d"}
Jul 29 04:03:33.206062 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.206039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsqxh" event={"ID":"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217","Type":"ContainerStarted","Data":"5bdd3a09cef1b854e92a591a3c8efd3b368087ea44fa28b981f1537f876e5c61"}
Jul 29 04:03:33.207235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.207213    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxxcs" event={"ID":"0c15446a-a3ba-49c2-8326-54de154abbe5","Type":"ContainerStarted","Data":"da7902f8171174939a9f3530ca757e06adb21ff68af4c19a3ea4089f2fc083dc"}
Jul 29 04:03:33.208316 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.208297    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerStarted","Data":"ee3b5a14a832e5a622852c231e6ba162cbf9f8355db492ead0dcc9ecd1dee0fa"}
Jul 29 04:03:33.209390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.209367    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"d621ffb53e91d4c942fcc75e420f6ba9e4f4317c3603f66bb9561281095345d6"}
Jul 29 04:03:33.210696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.210530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pb2cf" event={"ID":"b72840df-ea6d-414d-b110-0bc7e3cd91d1","Type":"ContainerStarted","Data":"cf139d964deddebdbecb22ec6bf00afefb8aff659bda7f777f1719191a4dba13"}
Jul 29 04:03:33.211684 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.211666    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5" event={"ID":"cd3ca4b7-2d17-4dea-af34-a7047a72126e","Type":"ContainerStarted","Data":"2930b261a938d247ece22e0374058af888621e397f202a7ffb418560c4ebd635"}
Jul 29 04:03:33.212884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.212858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvxfx" event={"ID":"fed1915d-3c73-4d25-b427-e119aecaa5b0","Type":"ContainerStarted","Data":"d1a65cb37ac10b03e4de08bdee5ac468040dfbedabb11ad8241322282ebe6778"}
Jul 29 04:03:33.215221 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.215181    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-12.ec2.internal" podStartSLOduration=1.215170283 podStartE2EDuration="1.215170283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:33.215074766 +0000 UTC m=+3.490091558" watchObservedRunningTime="2026-07-29 04:03:33.215170283 +0000 UTC m=+3.490187073"
Jul 29 04:03:33.679319 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.679229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:33.679499 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.679443    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:33.679568 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.679514    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:03:35.679492263 +0000 UTC m=+5.954509135 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:33.779653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.779615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:33.779852 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.779802    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:33.779930 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.779869    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:35.7798497 +0000 UTC m=+6.054866484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:33.880456 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:33.880417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:33.880653 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.880635    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:33.880720 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.880662    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:33.880720 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.880677    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:33.880852 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:33.880742    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:35.880722131 +0000 UTC m=+6.155738902 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:34.091675 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.091639    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 29 04:03:34.092276 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.092043    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-28 03:58:32 +0000 UTC" deadline="2028-05-03 05:04:00.383218072 +0000 UTC"
Jul 29 04:03:34.092276 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.092095    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15457h0m26.291130747s"
Jul 29 04:03:34.189960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.189929    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:34.190123 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:34.190060    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:34.190488 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.190467    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:34.190604 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:34.190584    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:34.191310 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.191292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:34.191442 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:34.191392    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:34.224227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.224198    2578 generic.go:356] "Generic (PLEG): container finished" podID="46ac9f45112ada261e00ec4f0b28a26a" containerID="c3bc779c3685c55eec133931f0f610786a5be70d101c4a2abb870879f46469b0" exitCode=0
Jul 29 04:03:34.225293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:34.225268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"46ac9f45112ada261e00ec4f0b28a26a","Type":"ContainerDied","Data":"c3bc779c3685c55eec133931f0f610786a5be70d101c4a2abb870879f46469b0"}
Jul 29 04:03:35.239727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:35.239649    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" event={"ID":"46ac9f45112ada261e00ec4f0b28a26a","Type":"ContainerStarted","Data":"557324c3e7d544e110e8c3069661ce102f8ce8484f36594ee1e6fb484a82567b"}
Jul 29 04:03:35.693315 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:35.693176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:35.693505 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.693374    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:35.693505 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.693458    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:03:39.693436862 +0000 UTC m=+9.968453633 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:35.794626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:35.794587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:35.794816 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.794771    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:35.794816 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.794854    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:39.794834461 +0000 UTC m=+10.069851233 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:35.896333 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:35.895682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:35.896333 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.895870    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:35.896333 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.895894    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:35.896333 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.895908    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:35.896333 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:35.895970    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:39.895949175 +0000 UTC m=+10.170965944 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:36.190686 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:36.189908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:36.190686 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:36.190057    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:36.190686 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:36.190477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:36.190686 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:36.190577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:36.191410 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:36.191186    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:36.191410 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:36.191291    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:38.189858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:38.189822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:38.190348 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:38.189955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:38.190348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:38.189836    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:38.190348 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:38.190031    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:38.190348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:38.189824    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:38.190348 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:38.190101    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:39.731685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:39.731653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:39.732176 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.731793    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:39.732176 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.731865    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:03:47.731844126 +0000 UTC m=+18.006860898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:39.832989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:39.832950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:39.833164 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.833143    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:39.833227 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.833209    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:47.833189236 +0000 UTC m=+18.108206013 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:39.934182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:39.934150    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:39.934376 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.934298    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:39.934376 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.934313    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:39.934376 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.934322    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:39.934376 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:39.934370    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:03:47.934351558 +0000 UTC m=+18.209368326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:40.190556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:40.190514    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:40.190727 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:40.190620    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:40.191022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:40.190989    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:40.191151 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:40.191074    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:40.191151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:40.191120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:40.191267 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:40.191173    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:42.190141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:42.190101    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:42.190635 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:42.190238    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:42.190717 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:42.190652    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:42.190859 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:42.190799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:42.190987 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:42.190904    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:42.191048 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:42.191018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:44.189704 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:44.189679    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:44.189704 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:44.189698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:44.190237 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:44.189818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:44.190237 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:44.189861    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:44.190237 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:44.189906    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:44.190237 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:44.189995    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:46.189395 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:46.189357    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:46.189395 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:46.189376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:46.189910 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:46.189485    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:46.189910 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:46.189531    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:46.189910 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:46.189640    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:46.189910 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:46.189785    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:47.799354 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:47.799312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:47.799793 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:47.799426    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:47.799793 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:47.799488    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:03.799473284 +0000 UTC m=+34.074490054 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:03:47.900331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:47.900298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:47.900473 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:47.900406    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:47.900473 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:47.900452    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:03.900438946 +0000 UTC m=+34.175455715 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:03:48.001491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:48.001460    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:48.001637 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.001593    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:03:48.001637 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.001607    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:03:48.001637 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.001629    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:48.001774 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.001677    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:04.001663515 +0000 UTC m=+34.276680292 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:48.189534    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:48.189574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.189668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:48.189767    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.189739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:48.189860 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:48.189845    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:50.190199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:50.190164    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:50.190634 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:50.190271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:50.190634 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:50.190270    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:50.190634 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:50.190365    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:50.190634 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:50.190468    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:50.190634 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:50.190535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:52.189333 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:52.189310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:52.189596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:52.189330    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:52.189596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:52.189317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:52.189596 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:52.189403    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:52.189596 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:52.189480    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:52.189596 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:52.189565    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:53.285010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.284771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4465m" event={"ID":"cb651ea7-f8e5-4090-a7d7-d369a789d9e8","Type":"ContainerStarted","Data":"5c0a06342a4c7ab740d2681fa9ab03cae84878b0c041ba10c5194949659751c7"}
Jul 29 04:03:53.286163 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.286130    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-c7zj9" event={"ID":"d8f66f9b-007e-4c36-b24c-29a9a1b67cff","Type":"ContainerStarted","Data":"9eac7ed0272bc3f6ed7f20ef6398826f82f768b61b650cdc0a281d4b4e13dc00"}
Jul 29 04:03:53.287317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.287295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hsqxh" event={"ID":"e8adbb30-a0d1-4caa-a2d6-1dde5d6de217","Type":"ContainerStarted","Data":"4603c88223df04aae7280ab6c9754593696bd2c9dc3f4d72c3cba16807aa0132"}
Jul 29 04:03:53.288655 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.288624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-xxxcs" event={"ID":"0c15446a-a3ba-49c2-8326-54de154abbe5","Type":"ContainerStarted","Data":"9227e0c8d9cbf4ba2ab2e77e4166ca60e4fabe8c1f3f6a16cc09d85eee7fc32c"}
Jul 29 04:03:53.290000 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.289978    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="45e82912bc584de0b653ea5d9be03a14481bee5f7b0614fca8952c45ff889d89" exitCode=0
Jul 29 04:03:53.290092 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.290043    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"45e82912bc584de0b653ea5d9be03a14481bee5f7b0614fca8952c45ff889d89"}
Jul 29 04:03:53.294131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294108    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"419404801c8f5bbf4f1a715cc1f95243ce5e1563712dc923773ffc09a5b211a7"}
Jul 29 04:03:53.294231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"c925e5d0e1285618376c84541b66b06768bcac2af7965e9d98906fd28bb7e5be"}
Jul 29 04:03:53.294231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"ef6036b24e169cbbfd59e2734df7c0ff059537cb98986047b4a1f2adc1e46e57"}
Jul 29 04:03:53.294328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"df5e4d39386a65947e82a29559aca7162efb6d00e326f8d3bbeaba4523533efd"}
Jul 29 04:03:53.294328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"54cea5c459b434335ecd256321d43e70b250d0f5f7bbe54885d4f05cb8cd11f9"}
Jul 29 04:03:53.294328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.294309    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"ca10849702371a8ea8cc020c88f9232d4e5fc443d3d7ffeb24822d466c0e7a1e"}
Jul 29 04:03:53.295465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.295446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5" event={"ID":"cd3ca4b7-2d17-4dea-af34-a7047a72126e","Type":"ContainerStarted","Data":"e12155b44fd9c033c3d25998ec50552e1237fefa7a06bc068f4806a2f3ccdb74"}
Jul 29 04:03:53.297113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.297092    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-tvxfx" event={"ID":"fed1915d-3c73-4d25-b427-e119aecaa5b0","Type":"ContainerStarted","Data":"ce88f9c4dad753015a801d7c1224f064884a1ab041990dbc8502e5627ad38a54"}
Jul 29 04:03:53.299531 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.299499    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-12.ec2.internal" podStartSLOduration=21.299486853 podStartE2EDuration="21.299486853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:35.255880604 +0000 UTC m=+5.530897398" watchObservedRunningTime="2026-07-29 04:03:53.299486853 +0000 UTC m=+23.574503641"
Jul 29 04:03:53.336731 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.336696    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4465m" podStartSLOduration=3.148219016 podStartE2EDuration="22.336684865s" totalImagesPullingTime="19.188465849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:53.298949479 +0000 UTC m=+23.573966269" watchObservedRunningTime="2026-07-29 04:03:53.336684865 +0000 UTC m=+23.611701653"
Jul 29 04:03:53.354303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.354269    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-tvxfx" podStartSLOduration=7.144730551 podStartE2EDuration="22.354258872s" totalImagesPullingTime="15.209528321s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:53.354250922 +0000 UTC m=+23.629267709" watchObservedRunningTime="2026-07-29 04:03:53.354258872 +0000 UTC m=+23.629275659"
Jul 29 04:03:53.368000 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.367969    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hsqxh" podStartSLOduration=3.175536995 podStartE2EDuration="22.367958681s" totalImagesPullingTime="19.192421686s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:53.367678735 +0000 UTC m=+23.642695539" watchObservedRunningTime="2026-07-29 04:03:53.367958681 +0000 UTC m=+23.642975468"
Jul 29 04:03:53.385645 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.385613    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-xxxcs" podStartSLOduration=3.177640184 podStartE2EDuration="22.385599343s" totalImagesPullingTime="19.207959159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:53.38521333 +0000 UTC m=+23.660230119" watchObservedRunningTime="2026-07-29 04:03:53.385599343 +0000 UTC m=+23.660616130"
Jul 29 04:03:53.402015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.401985    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-c7zj9" podStartSLOduration=3.177013632 podStartE2EDuration="22.401978637s" totalImagesPullingTime="19.224965005s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:53.40188732 +0000 UTC m=+23.676904107" watchObservedRunningTime="2026-07-29 04:03:53.401978637 +0000 UTC m=+23.676995424"
Jul 29 04:03:53.652870 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:53.652851    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 29 04:03:54.110183 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.110070    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-29T04:03:53.652865758Z","UUID":"3c4ec2c1-951d-4d82-aa0a-4136c251cf86","Handler":null,"Name":"","Endpoint":""}
Jul 29 04:03:54.111765 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.111733    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 29 04:03:54.111889 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.111787    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 29 04:03:54.189884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.189858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:54.190017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.189863    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:54.190017 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:54.189971    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:54.190129 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:54.190049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:54.190129 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.189863    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:54.190225 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:54.190126    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:54.304359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.304323    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-pb2cf" event={"ID":"b72840df-ea6d-414d-b110-0bc7e3cd91d1","Type":"ContainerStarted","Data":"e64690bd56ca0ea6387b51b325753e214cf8696b246f31c1cacf02a8585e39bc"}
Jul 29 04:03:54.306318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.306291    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5" event={"ID":"cd3ca4b7-2d17-4dea-af34-a7047a72126e","Type":"ContainerStarted","Data":"bfc22bdcb690e903838681f29361ae8597333eb475021669d54a7995ce414f27"}
Jul 29 04:03:54.319027 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.318984    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-pb2cf" podStartSLOduration=4.122620438 podStartE2EDuration="23.318972879s" totalImagesPullingTime="19.196352441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:54.318544718 +0000 UTC m=+24.593561530" watchObservedRunningTime="2026-07-29 04:03:54.318972879 +0000 UTC m=+24.593989666"
Jul 29 04:03:54.378997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:54.378939    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:55.311976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:55.311936    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"52e62c749d217f7f14f38aea123b5e67d2ec03f3a8dad4c28bafd9525eab5ea9"}
Jul 29 04:03:55.314138 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:55.314110    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5" event={"ID":"cd3ca4b7-2d17-4dea-af34-a7047a72126e","Type":"ContainerStarted","Data":"56ac03d60cc661e6049b45c53359fe0aee05cfae64a1b64f3ab4e84445ef550e"}
Jul 29 04:03:55.331444 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:55.331396    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-tnvz5" podStartSLOduration=2.851126004 podStartE2EDuration="24.331381007s" totalImagesPullingTime="21.480255003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:55.331072766 +0000 UTC m=+25.606089553" watchObservedRunningTime="2026-07-29 04:03:55.331381007 +0000 UTC m=+25.606397795"
Jul 29 04:03:55.711944 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:55.711872    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:55.712411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:55.712394    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:56.189500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:56.189317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:56.189685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:56.189325    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:56.189685 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:56.189611    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:56.189685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:56.189376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:56.189685 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:56.189667    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:56.189939 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:56.189769    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:56.317214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:56.317188    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4465m"
Jul 29 04:03:58.190092 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.189920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:58.190819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.189920    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:58.190819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.189933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:58.190819 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:58.190254    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:03:58.190819 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:58.190323    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:58.190819 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:58.190153    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:58.321814 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.321789    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="0bffd590bd38f6dadbb4051230d7f969d7324d036bd6076272b8eb9ba748ff85" exitCode=0
Jul 29 04:03:58.321973 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.321872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"0bffd590bd38f6dadbb4051230d7f969d7324d036bd6076272b8eb9ba748ff85"}
Jul 29 04:03:58.325564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.325544    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" event={"ID":"71cca990-0ce8-4bd7-9434-04d6a806c4a4","Type":"ContainerStarted","Data":"1db1dca6d1884dec6fecd230fe181178d8ac771cc11ce2c829fbff9f84815156"}
Jul 29 04:03:58.325786 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.325731    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:58.325899 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.325830    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:58.325899 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.325877    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:58.340369 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.340348    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:58.340466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.340442    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:03:58.366691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:58.366653    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5" podStartSLOduration=8.11564512 podStartE2EDuration="27.366641362s" totalImagesPullingTime="19.250996242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:03:58.366139017 +0000 UTC m=+28.641155816" watchObservedRunningTime="2026-07-29 04:03:58.366641362 +0000 UTC m=+28.641658190"
Jul 29 04:03:59.330029 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.329993    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg8fx"]
Jul 29 04:03:59.331965 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.330163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:03:59.331965 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:59.330309    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:03:59.334175 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.334138    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97qpv"]
Jul 29 04:03:59.334306 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.334235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:03:59.334386 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:59.334329    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:03:59.334731 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.334707    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mzg2n"]
Jul 29 04:03:59.334847 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:03:59.334804    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:03:59.334892 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:03:59.334872    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:04:00.332190 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:00.332157    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="38625e9660e050cafa9c292fbee6ec8fc1bae42377ab01fa687bf35147c001d5" exitCode=0
Jul 29 04:04:00.332685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:00.332241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"38625e9660e050cafa9c292fbee6ec8fc1bae42377ab01fa687bf35147c001d5"}
Jul 29 04:04:01.189148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:01.189115    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:01.189323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:01.189171    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:01.189323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:01.189120    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:01.189323 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:01.189231    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:04:01.189432 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:01.189333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:04:01.189432 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:01.189422    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:04:02.338445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:02.338271    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="e7bcad3308276546135d433347d9d5fd4cc49fd3b57e333e29d787ee85f6a683" exitCode=0
Jul 29 04:04:02.338445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:02.338351    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"e7bcad3308276546135d433347d9d5fd4cc49fd3b57e333e29d787ee85f6a683"}
Jul 29 04:04:03.190063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:03.190024    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:03.190063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:03.190054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:03.190305 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:03.190039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:03.190305 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.190143    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:04:03.190305 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.190220    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:04:03.190305 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.190275    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:04:03.820394 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:03.820338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:03.820394 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.820385    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:03.820861 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.820463    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs podName:c1759f39-c5c2-4798-a020-b3585fe0867e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:35.820433944 +0000 UTC m=+66.095450713 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs") pod "network-metrics-daemon-qg8fx" (UID: "c1759f39-c5c2-4798-a020-b3585fe0867e") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 29 04:04:03.920970 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:03.920938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:03.921122 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.921088    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:03.921184 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:03.921153    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret podName:99b6074b-caea-4900-9ce6-34596a3df637 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:35.921133314 +0000 UTC m=+66.196150098 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret") pod "global-pull-secret-syncer-97qpv" (UID: "99b6074b-caea-4900-9ce6-34596a3df637") : object "kube-system"/"original-pull-secret" not registered
Jul 29 04:04:04.021462 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:04.021430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:04.021630 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:04.021544    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 29 04:04:04.021630 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:04.021559    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 29 04:04:04.021630 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:04.021571    2578 projected.go:196] Error preparing data for projected volume kube-api-access-85l9r for pod openshift-network-diagnostics/network-check-target-mzg2n: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:04.021630 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:04.021627    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r podName:67dd538d-a783-4a71-9119-9bd80c1cece4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:36.021611791 +0000 UTC m=+66.296628577 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-85l9r" (UniqueName: "kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r") pod "network-check-target-mzg2n" (UID: "67dd538d-a783-4a71-9119-9bd80c1cece4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 29 04:04:05.189656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:05.189627    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:05.189656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:05.189659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:05.190289 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:05.189659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:05.190289 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:05.189775    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-qg8fx" podUID="c1759f39-c5c2-4798-a020-b3585fe0867e"
Jul 29 04:04:05.190289 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:05.189834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-97qpv" podUID="99b6074b-caea-4900-9ce6-34596a3df637"
Jul 29 04:04:05.190289 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:05.189930    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mzg2n" podUID="67dd538d-a783-4a71-9119-9bd80c1cece4"
Jul 29 04:04:06.103729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.103648    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-12.ec2.internal" event="NodeReady"
Jul 29 04:04:06.103908 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.103836    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 29 04:04:06.135461 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.135430    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"]
Jul 29 04:04:06.137722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.137699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"
Jul 29 04:04:06.139086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.138974    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:04:06.140257 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.140237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-llfnr\""
Jul 29 04:04:06.140459 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.140435    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.140688 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.140672    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.140777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.140763    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.143227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.143208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 29 04:04:06.143314 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.143268    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 29 04:04:06.143314 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.143290    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 29 04:04:06.143390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.143212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qmdc2\""
Jul 29 04:04:06.147378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.146864    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"]
Jul 29 04:04:06.148678 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.148630    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 29 04:04:06.148893 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.148873    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"]
Jul 29 04:04:06.151381 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.149063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.151381 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.151346    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.151641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.151246    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"]
Jul 29 04:04:06.152269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.152250    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 29 04:04:06.152773 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.152671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.154143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.153367    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-rnjk6\""
Jul 29 04:04:06.154143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.153653    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.154143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.153727    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.154143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.153653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"]
Jul 29 04:04:06.154560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.154738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154717    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.154862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5dpr4\""
Jul 29 04:04:06.154862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 29 04:04:06.154946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 29 04:04:06.154946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.154721    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 29 04:04:06.155908 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.155891    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 29 04:04:06.156943 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.156774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 29 04:04:06.156943 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.156775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6hcnc\""
Jul 29 04:04:06.157144 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.157125    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5fb4f4744f-ltrx6"]
Jul 29 04:04:06.157336 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.157314    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.158856 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.158835    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"]
Jul 29 04:04:06.158970 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.158952    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.160419    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.160449    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.161320    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-rx86g\""
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.161600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.162447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.162861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.162843    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 29 04:04:06.163290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.163271    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 29 04:04:06.163800 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.163776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 29 04:04:06.164064 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.164045    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 29 04:04:06.164456 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.163909    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vmhjl\""
Jul 29 04:04:06.164793 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.164775    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 29 04:04:06.165420 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.165038    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.166965 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.166944    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"]
Jul 29 04:04:06.167089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.166989    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:04:06.167209 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.167119    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.172817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.170363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 29 04:04:06.172817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.170638    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.172817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.170852    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l4g4k\""
Jul 29 04:04:06.172817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.171190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"]
Jul 29 04:04:06.173718 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.173700    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.174193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.174175    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"]
Jul 29 04:04:06.175086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.174996    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"]
Jul 29 04:04:06.176157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.175905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"]
Jul 29 04:04:06.176984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.176970    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"]
Jul 29 04:04:06.177784 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.177762    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ks8v9"]
Jul 29 04:04:06.180667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.180650    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-sg5z7"]
Jul 29 04:04:06.180855 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.180832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.182578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.182561    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-frgcp"]
Jul 29 04:04:06.182709 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.182690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.183859 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.183838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 29 04:04:06.184039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.183956    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m6rk\""
Jul 29 04:04:06.184039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.183840    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 29 04:04:06.185004 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.184987    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.185201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.185180    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-64qnw"]
Jul 29 04:04:06.185369 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.185345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.186366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.186116    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 29 04:04:06.186366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.186141    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 29 04:04:06.186366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.186282    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.187774 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.187737    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x66cf\""
Jul 29 04:04:06.189705 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.189680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 29 04:04:06.190239 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.189983    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-kkxhf\""
Jul 29 04:04:06.190326 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.190306    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 29 04:04:06.190385 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.190309    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.190544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.190527    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.190835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.190688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.193633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.193600    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-p8dgx\""
Jul 29 04:04:06.194067 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.193584    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.194682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.194360    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 29 04:04:06.196358 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.195946    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.196358 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.196067    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 29 04:04:06.196979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.196960    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"]
Jul 29 04:04:06.197272 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.197254    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 29 04:04:06.203519 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203499    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fb4f4744f-ltrx6"]
Jul 29 04:04:06.203626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203538    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ks8v9"]
Jul 29 04:04:06.203626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203563    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64qnw"]
Jul 29 04:04:06.203626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203581    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"]
Jul 29 04:04:06.203626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-sg5z7"]
Jul 29 04:04:06.203626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203613    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-frgcp"]
Jul 29 04:04:06.203882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.203708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"
Jul 29 04:04:06.206146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.206130    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-qszvb\""
Jul 29 04:04:06.206276 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.206257    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 29 04:04:06.206518 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.206502    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 29 04:04:06.239917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.239897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdn94\" (UniqueName: \"kubernetes.io/projected/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-kube-api-access-bdn94\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.240022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.239928    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ptgcf\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.239958    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kc8nf\" (UniqueName: \"kubernetes.io/projected/b4627155-cd92-4def-a6e8-1477a4bec7fe-kube-api-access-kc8nf\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.240022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-snapshots\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/896876a8-2a55-4822-bab3-2dfbad6e5d99-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d36f6db-3a79-4416-91f4-f1144977d617-config-volume\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g596c\" (UniqueName: \"kubernetes.io/projected/196438db-4df3-4185-ab5a-9ec7289ca1e3-kube-api-access-g596c\") pod \"volume-data-source-validator-549c6d54cf-4kz7m\" (UID: \"196438db-4df3-4185-ab5a-9ec7289ca1e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-trusted-ca\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4627155-cd92-4def-a6e8-1477a4bec7fe-serving-cert\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.240182 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nd4v7\" (UniqueName: \"kubernetes.io/projected/fc55f329-db6f-407b-a0ee-6a643ea4d03d-kube-api-access-nd4v7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc55f329-db6f-407b-a0ee-6a643ea4d03d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240286    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlwnt\" (UniqueName: \"kubernetes.io/projected/2702597e-99c7-4f44-8cb2-c9ee052dc112-kube-api-access-qlwnt\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19886b27-424c-47bf-b46c-6a0ef0c38420-config\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc55f329-db6f-407b-a0ee-6a643ea4d03d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2702597e-99c7-4f44-8cb2-c9ee052dc112-serving-cert\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.240469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdcdz\" (UniqueName: \"kubernetes.io/projected/19886b27-424c-47bf-b46c-6a0ef0c38420-kube-api-access-vdcdz\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rkh2\" (UniqueName: \"kubernetes.io/projected/6d36f6db-3a79-4416-91f4-f1144977d617-kube-api-access-7rkh2\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240580    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0551bf59-fbf5-4bdf-80ed-1d05450f922e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-cert\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240644    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d36f6db-3a79-4416-91f4-f1144977d617-tmp-dir\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240805    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-default-certificate\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6khd\" (UniqueName: \"kubernetes.io/projected/4be382cc-38f1-49f5-b828-d446fd08660e-kube-api-access-n6khd\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.240960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.240993    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w57hj\" (UniqueName: \"kubernetes.io/projected/36a75980-e622-410c-973f-a21cb2a908c4-kube-api-access-w57hj\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rv8k\" (UniqueName: \"kubernetes.io/projected/6414b838-ceb5-494d-b3f9-ef0d00406e8d-kube-api-access-9rv8k\") pod \"network-check-source-7d88cb55d8-sx7z8\" (UID: \"6414b838-ceb5-494d-b3f9-ef0d00406e8d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241057    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19886b27-424c-47bf-b46c-6a0ef0c38420-serving-cert\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241085    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-tmp\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-config\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-stats-auth\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-service-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4rrmh\" (UniqueName: \"kubernetes.io/projected/896876a8-2a55-4822-bab3-2dfbad6e5d99-kube-api-access-4rrmh\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.241512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.241275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.341683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.341652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/896876a8-2a55-4822-bab3-2dfbad6e5d99-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.341915 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.341696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d36f6db-3a79-4416-91f4-f1144977d617-config-volume\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.341915 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.341723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g596c\" (UniqueName: \"kubernetes.io/projected/196438db-4df3-4185-ab5a-9ec7289ca1e3-kube-api-access-g596c\") pod \"volume-data-source-validator-549c6d54cf-4kz7m\" (UID: \"196438db-4df3-4185-ab5a-9ec7289ca1e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"
Jul 29 04:04:06.341915 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.341903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.342081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.341945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-trusted-ca\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.342081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342000    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4627155-cd92-4def-a6e8-1477a4bec7fe-serving-cert\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.342081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nd4v7\" (UniqueName: \"kubernetes.io/projected/fc55f329-db6f-407b-a0ee-6a643ea4d03d-kube-api-access-nd4v7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.342081 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.342046    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:06.342081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc55f329-db6f-407b-a0ee-6a643ea4d03d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.342107    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.842088385 +0000 UTC m=+37.117105156 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlwnt\" (UniqueName: \"kubernetes.io/projected/2702597e-99c7-4f44-8cb2-c9ee052dc112-kube-api-access-qlwnt\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19886b27-424c-47bf-b46c-6a0ef0c38420-config\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.342290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342286    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc55f329-db6f-407b-a0ee-6a643ea4d03d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342311    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2702597e-99c7-4f44-8cb2-c9ee052dc112-serving-cert\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdcdz\" (UniqueName: \"kubernetes.io/projected/19886b27-424c-47bf-b46c-6a0ef0c38420-kube-api-access-vdcdz\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342359    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/6d36f6db-3a79-4416-91f4-f1144977d617-config-volume\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rkh2\" (UniqueName: \"kubernetes.io/projected/6d36f6db-3a79-4416-91f4-f1144977d617-kube-api-access-7rkh2\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0551bf59-fbf5-4bdf-80ed-1d05450f922e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-cert\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/896876a8-2a55-4822-bab3-2dfbad6e5d99-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.342556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d36f6db-3a79-4416-91f4-f1144977d617-tmp-dir\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.342624    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.342639    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.342678    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.8426636 +0000 UTC m=+37.117680366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:06.342957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-trusted-ca\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.343643 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.343326    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.843308155 +0000 UTC m=+37.118324926 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:06.343643 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.343580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.343829 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.343659    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.343875 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.342626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-default-certificate\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.343875 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.343857    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:06.343959 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.343886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6khd\" (UniqueName: \"kubernetes.io/projected/4be382cc-38f1-49f5-b828-d446fd08660e-kube-api-access-n6khd\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.343959 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.343909    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.843895835 +0000 UTC m=+37.118912606 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:06.343959 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.343945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.344084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.343976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.344084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.344084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w57hj\" (UniqueName: \"kubernetes.io/projected/36a75980-e622-410c-973f-a21cb2a908c4-kube-api-access-w57hj\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.344084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344056    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rv8k\" (UniqueName: \"kubernetes.io/projected/6414b838-ceb5-494d-b3f9-ef0d00406e8d-kube-api-access-9rv8k\") pod \"network-check-source-7d88cb55d8-sx7z8\" (UID: \"6414b838-ceb5-494d-b3f9-ef0d00406e8d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344081    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fc55f329-db6f-407b-a0ee-6a643ea4d03d-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19886b27-424c-47bf-b46c-6a0ef0c38420-serving-cert\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.344108    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.344144    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.844132151 +0000 UTC m=+37.119148921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-tmp\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.344191    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-config\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.344233 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.344223    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.844212457 +0000 UTC m=+37.119229232 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344239    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-stats-auth\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-service-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344296    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4rrmh\" (UniqueName: \"kubernetes.io/projected/896876a8-2a55-4822-bab3-2dfbad6e5d99-kube-api-access-4rrmh\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344357    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdn94\" (UniqueName: \"kubernetes.io/projected/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-kube-api-access-bdn94\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ptgcf\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kc8nf\" (UniqueName: \"kubernetes.io/projected/b4627155-cd92-4def-a6e8-1477a4bec7fe-kube-api-access-kc8nf\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.344599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-snapshots\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.344996 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/19886b27-424c-47bf-b46c-6a0ef0c38420-config\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.344996 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344740    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d36f6db-3a79-4416-91f4-f1144977d617-tmp-dir\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.344996 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.344821    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b4627155-cd92-4def-a6e8-1477a4bec7fe-config\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.345141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.345027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-snapshots\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.345141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.345044    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2702597e-99c7-4f44-8cb2-c9ee052dc112-tmp\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.345141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.345069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.345905 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.345641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2702597e-99c7-4f44-8cb2-c9ee052dc112-service-ca-bundle\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.345987 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.345933    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:06.346052 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.345989    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:06.845974607 +0000 UTC m=+37.120991373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:06.346114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.346074    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/0551bf59-fbf5-4bdf-80ed-1d05450f922e-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.346559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.346528    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.348455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.348429    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2702597e-99c7-4f44-8cb2-c9ee052dc112-serving-cert\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.348545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.348477    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-stats-auth\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.348669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.348647    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-default-certificate\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.348730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.348677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/19886b27-424c-47bf-b46c-6a0ef0c38420-serving-cert\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.348730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.348678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fc55f329-db6f-407b-a0ee-6a643ea4d03d-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.349036 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.349017    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.349395 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.349342    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.350309 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.350288    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-cert\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.350487 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.350470    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b4627155-cd92-4def-a6e8-1477a4bec7fe-serving-cert\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.352458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.352437    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g596c\" (UniqueName: \"kubernetes.io/projected/196438db-4df3-4185-ab5a-9ec7289ca1e3-kube-api-access-g596c\") pod \"volume-data-source-validator-549c6d54cf-4kz7m\" (UID: \"196438db-4df3-4185-ab5a-9ec7289ca1e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"
Jul 29 04:04:06.361360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.361087    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlwnt\" (UniqueName: \"kubernetes.io/projected/2702597e-99c7-4f44-8cb2-c9ee052dc112-kube-api-access-qlwnt\") pod \"insights-operator-5885fdb759-sg5z7\" (UID: \"2702597e-99c7-4f44-8cb2-c9ee052dc112\") " pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.361360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.361274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6khd\" (UniqueName: \"kubernetes.io/projected/4be382cc-38f1-49f5-b828-d446fd08660e-kube-api-access-n6khd\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.362195 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.362170    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdcdz\" (UniqueName: \"kubernetes.io/projected/19886b27-424c-47bf-b46c-6a0ef0c38420-kube-api-access-vdcdz\") pod \"service-ca-operator-5d6c75f84f-twnrn\" (UID: \"19886b27-424c-47bf-b46c-6a0ef0c38420\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.362560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.362529    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4rrmh\" (UniqueName: \"kubernetes.io/projected/896876a8-2a55-4822-bab3-2dfbad6e5d99-kube-api-access-4rrmh\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.362669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.362569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rkh2\" (UniqueName: \"kubernetes.io/projected/6d36f6db-3a79-4416-91f4-f1144977d617-kube-api-access-7rkh2\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.363045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.363026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nd4v7\" (UniqueName: \"kubernetes.io/projected/fc55f329-db6f-407b-a0ee-6a643ea4d03d-kube-api-access-nd4v7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds\" (UID: \"fc55f329-db6f-407b-a0ee-6a643ea4d03d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.363616 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.363578    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w57hj\" (UniqueName: \"kubernetes.io/projected/36a75980-e622-410c-973f-a21cb2a908c4-kube-api-access-w57hj\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.364085 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.364059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdn94\" (UniqueName: \"kubernetes.io/projected/4aabdd1e-2246-4a06-9a94-227a7a9d8e2f-kube-api-access-bdn94\") pod \"ingress-canary-64qnw\" (UID: \"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f\") " pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.364163 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.364098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.364298 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.364254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ptgcf\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.365128 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.365105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rv8k\" (UniqueName: \"kubernetes.io/projected/6414b838-ceb5-494d-b3f9-ef0d00406e8d-kube-api-access-9rv8k\") pod \"network-check-source-7d88cb55d8-sx7z8\" (UID: \"6414b838-ceb5-494d-b3f9-ef0d00406e8d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"
Jul 29 04:04:06.365971 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.365953    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kc8nf\" (UniqueName: \"kubernetes.io/projected/b4627155-cd92-4def-a6e8-1477a4bec7fe-kube-api-access-kc8nf\") pod \"console-operator-584dcb6b54-frgcp\" (UID: \"b4627155-cd92-4def-a6e8-1477a4bec7fe\") " pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.382595 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.382536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:06.452470 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.452438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"
Jul 29 04:04:06.463803 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.463774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:06.475641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.475621    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"
Jul 29 04:04:06.502847 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.502813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"
Jul 29 04:04:06.533048 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.533020    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-sg5z7"
Jul 29 04:04:06.541017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.540993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:06.547048 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.547027    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-64qnw"
Jul 29 04:04:06.553481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.553464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.852982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853259    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.853498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853589    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853641    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.853635237 +0000 UTC m=+38.128652024 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853674    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.853664285 +0000 UTC m=+38.128681064 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:06.853775 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853737    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:06.854474 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854204    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:06.854474 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854425    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:06.854474 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854282    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.854265536 +0000 UTC m=+38.129282317 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:06.854620 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854518    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.854503029 +0000 UTC m=+38.129519811 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:06.854620 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854533    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.854525181 +0000 UTC m=+38.129541961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:06.854620 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.853589    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:06.854794 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854771    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.854735916 +0000 UTC m=+38.129752702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:06.854794 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854361    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:06.854899 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:06.854817    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:07.854807965 +0000 UTC m=+38.129824745 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:06.907046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.906890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:06.955580 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.955170    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8"]
Jul 29 04:04:06.966108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.966083    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m"]
Jul 29 04:04:06.970711 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.970686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn"]
Jul 29 04:04:06.974203 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.974180    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds"]
Jul 29 04:04:06.975524 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.975496    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-sg5z7"]
Jul 29 04:04:06.986014 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.985985    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-64qnw"]
Jul 29 04:04:06.987232 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:06.987213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-frgcp"]
Jul 29 04:04:06.989880 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.989847    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc55f329_db6f_407b_a0ee_6a643ea4d03d.slice/crio-1ffa700c57609924125a1cce96cf3bda2b5b42ed8a821cdc837b44211af091fc WatchSource:0}: Error finding container 1ffa700c57609924125a1cce96cf3bda2b5b42ed8a821cdc837b44211af091fc: Status 404 returned error can't find the container with id 1ffa700c57609924125a1cce96cf3bda2b5b42ed8a821cdc837b44211af091fc
Jul 29 04:04:06.990642 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.990601    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4627155_cd92_4def_a6e8_1477a4bec7fe.slice/crio-15fdfd612b5ba4e63060c34d5adfcb01c1a4fb6d395e2f502a5ed957ccf6cf48 WatchSource:0}: Error finding container 15fdfd612b5ba4e63060c34d5adfcb01c1a4fb6d395e2f502a5ed957ccf6cf48: Status 404 returned error can't find the container with id 15fdfd612b5ba4e63060c34d5adfcb01c1a4fb6d395e2f502a5ed957ccf6cf48
Jul 29 04:04:06.991512 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.991438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aabdd1e_2246_4a06_9a94_227a7a9d8e2f.slice/crio-65a63a2465f38b4951b778180588658b248272ff32c34930c2d2a570e1781b60 WatchSource:0}: Error finding container 65a63a2465f38b4951b778180588658b248272ff32c34930c2d2a570e1781b60: Status 404 returned error can't find the container with id 65a63a2465f38b4951b778180588658b248272ff32c34930c2d2a570e1781b60
Jul 29 04:04:06.992646 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.992615    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod196438db_4df3_4185_ab5a_9ec7289ca1e3.slice/crio-ce6458a885fa1a8c9c895faeb3cb574e052b12dffc236836e286d30f2f585a79 WatchSource:0}: Error finding container ce6458a885fa1a8c9c895faeb3cb574e052b12dffc236836e286d30f2f585a79: Status 404 returned error can't find the container with id ce6458a885fa1a8c9c895faeb3cb574e052b12dffc236836e286d30f2f585a79
Jul 29 04:04:06.993559 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.993525    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19886b27_424c_47bf_b46c_6a0ef0c38420.slice/crio-a72240fd6b3c28d12c25249a2c2789da75063f50f60423e149c3edba4c62d3d5 WatchSource:0}: Error finding container a72240fd6b3c28d12c25249a2c2789da75063f50f60423e149c3edba4c62d3d5: Status 404 returned error can't find the container with id a72240fd6b3c28d12c25249a2c2789da75063f50f60423e149c3edba4c62d3d5
Jul 29 04:04:06.995810 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.995434    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6414b838_ceb5_494d_b3f9_ef0d00406e8d.slice/crio-df21cad1e6de1b4be6a465b8aefb0c8d2d7c92e6a30ea8441492d775ae49a813 WatchSource:0}: Error finding container df21cad1e6de1b4be6a465b8aefb0c8d2d7c92e6a30ea8441492d775ae49a813: Status 404 returned error can't find the container with id df21cad1e6de1b4be6a465b8aefb0c8d2d7c92e6a30ea8441492d775ae49a813
Jul 29 04:04:06.995810 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:06.995703    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2702597e_99c7_4f44_8cb2_c9ee052dc112.slice/crio-15444b37b31c6807ea62cf9d40f404a7f65e9df54e5c4580d7330d3189a808c9 WatchSource:0}: Error finding container 15444b37b31c6807ea62cf9d40f404a7f65e9df54e5c4580d7330d3189a808c9: Status 404 returned error can't find the container with id 15444b37b31c6807ea62cf9d40f404a7f65e9df54e5c4580d7330d3189a808c9
Jul 29 04:04:07.189286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.189252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:07.189413 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.189266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:07.189413 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.189374    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:07.191981 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.191960    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 04:04:07.192477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.192005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 04:04:07.192477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.192050    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bzqwr\""
Jul 29 04:04:07.192477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.192005    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrbfg\""
Jul 29 04:04:07.352578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.352541    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-sg5z7" event={"ID":"2702597e-99c7-4f44-8cb2-c9ee052dc112","Type":"ContainerStarted","Data":"15444b37b31c6807ea62cf9d40f404a7f65e9df54e5c4580d7330d3189a808c9"}
Jul 29 04:04:07.353679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.353646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m" event={"ID":"196438db-4df3-4185-ab5a-9ec7289ca1e3","Type":"ContainerStarted","Data":"ce6458a885fa1a8c9c895faeb3cb574e052b12dffc236836e286d30f2f585a79"}
Jul 29 04:04:07.354838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.354812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8" event={"ID":"6414b838-ceb5-494d-b3f9-ef0d00406e8d","Type":"ContainerStarted","Data":"df21cad1e6de1b4be6a465b8aefb0c8d2d7c92e6a30ea8441492d775ae49a813"}
Jul 29 04:04:07.355881 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.355857    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds" event={"ID":"fc55f329-db6f-407b-a0ee-6a643ea4d03d","Type":"ContainerStarted","Data":"1ffa700c57609924125a1cce96cf3bda2b5b42ed8a821cdc837b44211af091fc"}
Jul 29 04:04:07.356941 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.356919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64qnw" event={"ID":"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f","Type":"ContainerStarted","Data":"65a63a2465f38b4951b778180588658b248272ff32c34930c2d2a570e1781b60"}
Jul 29 04:04:07.358014 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.357983    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" event={"ID":"b4627155-cd92-4def-a6e8-1477a4bec7fe","Type":"ContainerStarted","Data":"15fdfd612b5ba4e63060c34d5adfcb01c1a4fb6d395e2f502a5ed957ccf6cf48"}
Jul 29 04:04:07.360930 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.360905    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="11f7a04d6cea60062a8c0c64375f1ba8bf2f3b9d607d2ecf6a9174d2706509c9" exitCode=0
Jul 29 04:04:07.361013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.360932    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"11f7a04d6cea60062a8c0c64375f1ba8bf2f3b9d607d2ecf6a9174d2706509c9"}
Jul 29 04:04:07.362287 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.362244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn" event={"ID":"19886b27-424c-47bf-b46c-6a0ef0c38420","Type":"ContainerStarted","Data":"a72240fd6b3c28d12c25249a2c2789da75063f50f60423e149c3edba4c62d3d5"}
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:07.864432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.864556    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.864613    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.864595248 +0000 UTC m=+40.139612019 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865024    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865074    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865059561 +0000 UTC m=+40.140076332 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865133    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865160    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865150658 +0000 UTC m=+40.140167429 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865228    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865258    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865249217 +0000 UTC m=+40.140265988 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:07.865544 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865317    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:07.866398 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865328    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:07.866398 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865358    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865345677 +0000 UTC m=+40.140362445 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:07.866398 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865419    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865409764 +0000 UTC m=+40.140426534 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:07.866398 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865471    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:07.866398 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:07.865497    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:09.865488737 +0000 UTC m=+40.140505507 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:08.371704 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:08.371436    2578 generic.go:356] "Generic (PLEG): container finished" podID="6b7af58c-724c-4b51-b2a6-df5a3ab4ba98" containerID="d36b39af19b5028f0a768037812d3b90e0709bea9f84ca8495f49be287e5a491" exitCode=0
Jul 29 04:04:08.371704 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:08.371627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerDied","Data":"d36b39af19b5028f0a768037812d3b90e0709bea9f84ca8495f49be287e5a491"}
Jul 29 04:04:09.365819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.365785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:09.382853 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.382794    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" event={"ID":"6b7af58c-724c-4b51-b2a6-df5a3ab4ba98","Type":"ContainerStarted","Data":"dac3950f906b84c2b29a8f9c6c79e8893ae1e917b90999649ab7009fabc7ddd7"}
Jul 29 04:04:09.405210 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.405157    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-j5lf5" podStartSLOduration=8.025606292 podStartE2EDuration="38.405137704s" totalImagesPullingTime="30.379531412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:09.403605355 +0000 UTC m=+39.678622168" watchObservedRunningTime="2026-07-29 04:04:09.405137704 +0000 UTC m=+39.680154494"
Jul 29 04:04:09.885812 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.885774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.885864    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.885921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.885966    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.885974    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.885996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.886026    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:09.886073 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886046    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886027998 +0000 UTC m=+44.161044764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:09.886097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886118    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886170    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886155324 +0000 UTC m=+44.161172115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886199    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886239    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886225675 +0000 UTC m=+44.161242475 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886244    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886280    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886268229 +0000 UTC m=+44.161284998 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886347    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886359    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886390    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.8863799 +0000 UTC m=+44.161396667 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:09.886451 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886455    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886444833 +0000 UTC m=+44.161461602 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:09.886975 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886515    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:09.886975 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:09.886548    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:13.886537965 +0000 UTC m=+44.161554738 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:10.127347 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:10.127317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:10.228100 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:10.228026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:13.921244 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921210    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921284    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921411    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.92139071 +0000 UTC m=+52.196407496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921467    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921484    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921529    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.921518014 +0000 UTC m=+52.196534795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:13.921525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921593    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921606    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:13.921622 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921617    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921638    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.921627695 +0000 UTC m=+52.196644478 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921653    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.92164463 +0000 UTC m=+52.196661404 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921684    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921710    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.92170152 +0000 UTC m=+52.196718302 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921827    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921898    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.921879469 +0000 UTC m=+52.196896246 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921911    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:13.922381 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:13.921971    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:21.921958231 +0000 UTC m=+52.196974997 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:14.694241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:14.694218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:15.408319 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.408272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-64qnw" event={"ID":"4aabdd1e-2246-4a06-9a94-227a7a9d8e2f","Type":"ContainerStarted","Data":"fb81d30b3ef4dd176971ec54eeea9afb1f555633243cae7ee29331f295daf427"}
Jul 29 04:04:15.410069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.410044    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/0.log"
Jul 29 04:04:15.410196 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.410088    2578 generic.go:356] "Generic (PLEG): container finished" podID="b4627155-cd92-4def-a6e8-1477a4bec7fe" containerID="55b9c6a733e1610022807b4cb7c5bf062f41bea779a7c4cad29e4b99e66998c8" exitCode=255
Jul 29 04:04:15.410252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.410185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" event={"ID":"b4627155-cd92-4def-a6e8-1477a4bec7fe","Type":"ContainerDied","Data":"55b9c6a733e1610022807b4cb7c5bf062f41bea779a7c4cad29e4b99e66998c8"}
Jul 29 04:04:15.410547 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.410529    2578 scope.go:117] "RemoveContainer" containerID="55b9c6a733e1610022807b4cb7c5bf062f41bea779a7c4cad29e4b99e66998c8"
Jul 29 04:04:15.413431 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.413375    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn" event={"ID":"19886b27-424c-47bf-b46c-6a0ef0c38420","Type":"ContainerStarted","Data":"770500c590210e115ffee06938a9ec669dfb75492d93374e8bff12a8fdb8ee42"}
Jul 29 04:04:15.415204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.415182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-sg5z7" event={"ID":"2702597e-99c7-4f44-8cb2-c9ee052dc112","Type":"ContainerStarted","Data":"cd25434b1be59c5144fa8a59ac500cf8d57597e35c31d1d95c252ceaede2efcd"}
Jul 29 04:04:15.416850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.416830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m" event={"ID":"196438db-4df3-4185-ab5a-9ec7289ca1e3","Type":"ContainerStarted","Data":"7a4176d3e35320d7ec0a889b6d3e091ba6a987d82e1ca68fec27a0ac8d1a66a8"}
Jul 29 04:04:15.418476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.418445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8" event={"ID":"6414b838-ceb5-494d-b3f9-ef0d00406e8d","Type":"ContainerStarted","Data":"7ac1f084534022ff56186f15f3d0ce41b373a691264d969d1274935b7fc3d8c8"}
Jul 29 04:04:15.420312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.420273    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds" event={"ID":"fc55f329-db6f-407b-a0ee-6a643ea4d03d","Type":"ContainerStarted","Data":"8710566c68276604b70e36fe2287c59ce9185161fa1632591def79cfb822c176"}
Jul 29 04:04:15.425268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.425224    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-64qnw" podStartSLOduration=1.634702011 podStartE2EDuration="9.425209165s" totalImagesPullingTime="7.790507154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.424940833 +0000 UTC m=+45.699957634" watchObservedRunningTime="2026-07-29 04:04:15.425209165 +0000 UTC m=+45.700225954"
Jul 29 04:04:15.441826 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.441230    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-sg5z7" podStartSLOduration=4.659712159 podStartE2EDuration="12.441213745s" totalImagesPullingTime="7.781501586s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.44090951 +0000 UTC m=+45.715926302" watchObservedRunningTime="2026-07-29 04:04:15.441213745 +0000 UTC m=+45.716230535"
Jul 29 04:04:15.455510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.455470    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-4kz7m" podStartSLOduration=4.708759376 podStartE2EDuration="12.455455242s" totalImagesPullingTime="7.746695866s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.454878187 +0000 UTC m=+45.729894979" watchObservedRunningTime="2026-07-29 04:04:15.455455242 +0000 UTC m=+45.730472031"
Jul 29 04:04:15.472115 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.472072    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn" podStartSLOduration=4.690610669 podStartE2EDuration="12.472055285s" totalImagesPullingTime="7.781444616s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.470643197 +0000 UTC m=+45.745659987" watchObservedRunningTime="2026-07-29 04:04:15.472055285 +0000 UTC m=+45.747072071"
Jul 29 04:04:15.512389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.512343    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds" podStartSLOduration=4.725183119 podStartE2EDuration="12.512323976s" totalImagesPullingTime="7.787140857s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.510667707 +0000 UTC m=+45.785684496" watchObservedRunningTime="2026-07-29 04:04:15.512323976 +0000 UTC m=+45.787340766"
Jul 29 04:04:15.526631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.526585    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-sx7z8" podStartSLOduration=4.744437183 podStartE2EDuration="12.526567285s" totalImagesPullingTime="7.782130102s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:15.526471417 +0000 UTC m=+45.801488212" watchObservedRunningTime="2026-07-29 04:04:15.526567285 +0000 UTC m=+45.801584073"
Jul 29 04:04:15.765126 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.765096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:15.860360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.860326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:15.939571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:15.939541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.034471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.034396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.281426 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.281392    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l6w5s"]
Jul 29 04:04:16.297317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.297237    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6w5s"]
Jul 29 04:04:16.297469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.297406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.300032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.299974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 29 04:04:16.300158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.300123    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 29 04:04:16.300158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.300150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xj8k\""
Jul 29 04:04:16.333717 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.333693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.344307 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.344281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.344433 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.344323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpk2m\" (UniqueName: \"kubernetes.io/projected/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-api-access-xpk2m\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.344433 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.344381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.344525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.344472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1547b10b-9358-41ab-bd3d-67131ea01beb-crio-socket\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.344569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.344527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1547b10b-9358-41ab-bd3d-67131ea01beb-data-volume\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.424672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.424653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:04:16.425068 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.425054    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/0.log"
Jul 29 04:04:16.425120 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.425086    2578 generic.go:356] "Generic (PLEG): container finished" podID="b4627155-cd92-4def-a6e8-1477a4bec7fe" containerID="7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f" exitCode=255
Jul 29 04:04:16.425153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.425115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" event={"ID":"b4627155-cd92-4def-a6e8-1477a4bec7fe","Type":"ContainerDied","Data":"7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f"}
Jul 29 04:04:16.425208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.425193    2578 scope.go:117] "RemoveContainer" containerID="55b9c6a733e1610022807b4cb7c5bf062f41bea779a7c4cad29e4b99e66998c8"
Jul 29 04:04:16.425355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.425338    2578 scope.go:117] "RemoveContainer" containerID="7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f"
Jul 29 04:04:16.425536 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.425515    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-frgcp_openshift-console-operator(b4627155-cd92-4def-a6e8-1477a4bec7fe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" podUID="b4627155-cd92-4def-a6e8-1477a4bec7fe"
Jul 29 04:04:16.445807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.445777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.445910 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.445828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpk2m\" (UniqueName: \"kubernetes.io/projected/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-api-access-xpk2m\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.445910 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.445893    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:16.446020 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.445954    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:16.945940705 +0000 UTC m=+47.220957474 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:16.446020 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.445955    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 04:04:16.446020 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.445893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.446020 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.446002    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:16.945987357 +0000 UTC m=+47.221004137 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : configmap "kube-rbac-proxy" not found
Jul 29 04:04:16.446197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.446049    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1547b10b-9358-41ab-bd3d-67131ea01beb-crio-socket\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.446197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.446088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1547b10b-9358-41ab-bd3d-67131ea01beb-data-volume\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.446297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.446256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1547b10b-9358-41ab-bd3d-67131ea01beb-crio-socket\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.446437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.446415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1547b10b-9358-41ab-bd3d-67131ea01beb-data-volume\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.454217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.454195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.458614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.458598    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpk2m\" (UniqueName: \"kubernetes.io/projected/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-api-access-xpk2m\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.508672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.508646    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.541949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.541926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:16.542034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.541964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:16.585303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.585226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.680627 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.680604    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:16.951801 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.951716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.951955 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:16.951814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:16.951955 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.951881    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:16.951955 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.951927    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 04:04:16.951955 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.951944    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:17.951928933 +0000 UTC m=+48.226945704 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:16.952089 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:16.951982    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:17.951967963 +0000 UTC m=+48.226984728 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : configmap "kube-rbac-proxy" not found
Jul 29 04:04:17.429980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:17.429947    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:04:17.430455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:17.430359    2578 scope.go:117] "RemoveContainer" containerID="7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f"
Jul 29 04:04:17.430588 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:17.430568    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-frgcp_openshift-console-operator(b4627155-cd92-4def-a6e8-1477a4bec7fe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" podUID="b4627155-cd92-4def-a6e8-1477a4bec7fe"
Jul 29 04:04:17.962208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:17.962168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:17.962373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:17.962227    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:17.962373 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:17.962317    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:17.962440 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:17.962368    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 04:04:17.962440 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:17.962381    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:19.962366018 +0000 UTC m=+50.237382785 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:17.962440 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:17.962416    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:19.962404513 +0000 UTC m=+50.237421278 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : configmap "kube-rbac-proxy" not found
Jul 29 04:04:17.993116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:17.993092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:18.093550 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.093521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:18.264781 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.264739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:18.365140 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.365113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:18.432905 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.432880    2578 scope.go:117] "RemoveContainer" containerID="7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f"
Jul 29 04:04:18.433230 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:18.433030    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-frgcp_openshift-console-operator(b4627155-cd92-4def-a6e8-1477a4bec7fe)\"" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" podUID="b4627155-cd92-4def-a6e8-1477a4bec7fe"
Jul 29 04:04:18.677907 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.677833    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsqxh_e8adbb30-a0d1-4caa-a2d6-1dde5d6de217/dns-node-resolver/0.log"
Jul 29 04:04:18.884646 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.884618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:18.983992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:18.983924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:19.348297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:19.348263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:19.678583 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:19.678516    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvxfx_fed1915d-3c73-4d25-b427-e119aecaa5b0/node-ca/0.log"
Jul 29 04:04:19.979802 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:19.979709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:19.979960 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:19.979845    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 29 04:04:19.979960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:19.979872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:19.979960 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:19.979920    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:23.979903215 +0000 UTC m=+54.254919981 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : configmap "kube-rbac-proxy" not found
Jul 29 04:04:19.980089 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:19.979990    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:19.980089 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:19.980036    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:23.980024712 +0000 UTC m=+54.255041478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:20.278328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:20.278296    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-64qnw_4aabdd1e-2246-4a06-9a94-227a7a9d8e2f/serve-healthcheck-canary/0.log"
Jul 29 04:04:21.078254 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.078215    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds_fc55f329-db6f-407b-a0ee-6a643ea4d03d/kube-storage-version-migrator-operator/0.log"
Jul 29 04:04:21.980021 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.979986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:21.998159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:21.998228 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:21.998264 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:21.998264 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:21.998363 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:21.998363 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998271    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 29 04:04:21.998363 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:21.998363 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998314    2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998373    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.99835406 +0000 UTC m=+68.273370845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : configmap references non-existent config key: service-ca.crt
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998374    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998384    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998400    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998418    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls podName:4be382cc-38f1-49f5-b828-d446fd08660e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998409239 +0000 UTC m=+68.273426012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls") pod "cluster-samples-operator-6748489656-mhl2z" (UID: "4be382cc-38f1-49f5-b828-d446fd08660e") : secret "samples-operator-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998435    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert podName:0551bf59-fbf5-4bdf-80ed-1d05450f922e nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998426792 +0000 UTC m=+68.273443558 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-7ph28" (UID: "0551bf59-fbf5-4bdf-80ed-1d05450f922e") : secret "networking-console-plugin-cert" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998404    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77948774df-tg6h4: secret "image-registry-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998449    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls podName:896876a8-2a55-4822-bab3-2dfbad6e5d99 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998442353 +0000 UTC m=+68.273459124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-xx4sg" (UID: "896876a8-2a55-4822-bab3-2dfbad6e5d99") : secret "cluster-monitoring-operator-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998476    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs podName:36a75980-e622-410c-973f-a21cb2a908c4 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998461405 +0000 UTC m=+68.273478171 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs") pod "router-default-5fb4f4744f-ltrx6" (UID: "36a75980-e622-410c-973f-a21cb2a908c4") : secret "router-metrics-certs-default" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998510    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls podName:1333f4c5-65d6-463c-acfb-fc254c797ece nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998487698 +0000 UTC m=+68.273504468 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls") pod "image-registry-77948774df-tg6h4" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece") : secret "image-registry-tls" not found
Jul 29 04:04:21.998573 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:21.998545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:21.998973 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998586    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 29 04:04:21.998973 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:21.998621    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls podName:6d36f6db-3a79-4416-91f4-f1144977d617 nodeName:}" failed. No retries permitted until 2026-07-29 04:04:37.998609908 +0000 UTC m=+68.273626675 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls") pod "dns-default-ks8v9" (UID: "6d36f6db-3a79-4416-91f4-f1144977d617") : secret "dns-default-metrics-tls" not found
Jul 29 04:04:22.132242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:22.132211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.239084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.239046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.462319 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.462282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.563729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.563694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.678262 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.678228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.763673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.763642    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:23.933677 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:23.933597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:24.015947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.015914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:24.016105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.015983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:24.016105 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:24.016059    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:24.016216 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:04:24.016128    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls podName:1547b10b-9358-41ab-bd3d-67131ea01beb nodeName:}" failed. No retries permitted until 2026-07-29 04:04:32.016112968 +0000 UTC m=+62.291129734 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l6w5s" (UID: "1547b10b-9358-41ab-bd3d-67131ea01beb") : secret "insights-runtime-extractor-tls" not found
Jul 29 04:04:24.016501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.016480    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1547b10b-9358-41ab-bd3d-67131ea01beb-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:24.497942 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.497907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:24.597691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.597665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:24.733291 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.733266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:24.931978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:24.931955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:25.336951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:25.336925    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:25.534966 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:25.534936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:25.736057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:25.735985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:25.938008 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:25.937979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:26.935858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:26.935821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:26.987008 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:26.986982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.133919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.133893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.336019 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.335981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.531775 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.531733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.733626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.733571    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.781281 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.781254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:27.933542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:27.933518    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:28.737339 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:28.737310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:28.838796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:28.838765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:28.891375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:28.891335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:28.944674 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:28.944654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:29.540838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:29.540801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:29.639550 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:29.639527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:29.938382 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:29.938310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:30.341274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:30.341245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:30.343258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:30.343239    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hjrt5"
Jul 29 04:04:30.539673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:30.539637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:31.132931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.132893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:31.190273 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.190237    2578 scope.go:117] "RemoveContainer" containerID="7502bebb2cbdf83f3497773b2b9894eaedbcbc4d54e0f339a15dde8cae7da09f"
Jul 29 04:04:31.473882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.473806    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:04:31.473882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.473854    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" event={"ID":"b4627155-cd92-4def-a6e8-1477a4bec7fe","Type":"ContainerStarted","Data":"7f2cb24268d30f5038a49220e5c0023e06b01ecb8f625e927f8d1e5252140710"}
Jul 29 04:04:31.474229 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.474205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:31.490713 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.490672    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp" podStartSLOduration=20.705135562 podStartE2EDuration="28.490658621s" totalImagesPullingTime="7.785523059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:31.489643752 +0000 UTC m=+61.764660540" watchObservedRunningTime="2026-07-29 04:04:31.490658621 +0000 UTC m=+61.765675409"
Jul 29 04:04:31.517072 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.517041    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-frgcp"
Jul 29 04:04:31.682187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.682156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:31.783499 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.783473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:31.834898 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.834870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:31.937059 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:31.937030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:32.038877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.038807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:32.080093 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.080060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:32.082278 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.082257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1547b10b-9358-41ab-bd3d-67131ea01beb-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l6w5s\" (UID: \"1547b10b-9358-41ab-bd3d-67131ea01beb\") " pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:32.139167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.139135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:32.209422 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.209395    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-2xj8k\""
Jul 29 04:04:32.217559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.217543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l6w5s"
Jul 29 04:04:32.342216 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.342192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l6w5s"]
Jul 29 04:04:32.344851 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:32.344823    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1547b10b_9358_41ab_bd3d_67131ea01beb.slice/crio-a80982ca41c352f233fc290e0ab6794296252bf157345e0b49184c172754b95a WatchSource:0}: Error finding container a80982ca41c352f233fc290e0ab6794296252bf157345e0b49184c172754b95a: Status 404 returned error can't find the container with id a80982ca41c352f233fc290e0ab6794296252bf157345e0b49184c172754b95a
Jul 29 04:04:32.480939 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.480480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6w5s" event={"ID":"1547b10b-9358-41ab-bd3d-67131ea01beb","Type":"ContainerStarted","Data":"a80982ca41c352f233fc290e0ab6794296252bf157345e0b49184c172754b95a"}
Jul 29 04:04:32.835797 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.835740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:32.887844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:32.887725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:33.767104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:33.767057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:33.815179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:33.815142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:33.935415 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:33.935383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:34.373187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:34.373157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:34.474375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:34.474346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:35.914649 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:35.914612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:35.917306 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:35.917280    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 29 04:04:35.927615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:35.927595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c1759f39-c5c2-4798-a020-b3585fe0867e-metrics-certs\") pod \"network-metrics-daemon-qg8fx\" (UID: \"c1759f39-c5c2-4798-a020-b3585fe0867e\") " pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:36.001259 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.001231    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mrbfg\""
Jul 29 04:04:36.009329 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.009303    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-qg8fx"
Jul 29 04:04:36.015848 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.015816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:36.018302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.018285    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 29 04:04:36.028724 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.028698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/99b6074b-caea-4900-9ce6-34596a3df637-original-pull-secret\") pod \"global-pull-secret-syncer-97qpv\" (UID: \"99b6074b-caea-4900-9ce6-34596a3df637\") " pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:36.116627 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.116597    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:36.119239 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.119210    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85l9r\" (UniqueName: \"kubernetes.io/projected/67dd538d-a783-4a71-9119-9bd80c1cece4-kube-api-access-85l9r\") pod \"network-check-target-mzg2n\" (UID: \"67dd538d-a783-4a71-9119-9bd80c1cece4\") " pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:36.307083 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.307059    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-bzqwr\""
Jul 29 04:04:36.308940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.308924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-97qpv"
Jul 29 04:04:36.315068 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:36.315049    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:37.133809 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.133392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-qg8fx"]
Jul 29 04:04:37.149832 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.149810    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mzg2n"]
Jul 29 04:04:37.151624 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:37.151601    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67dd538d_a783_4a71_9119_9bd80c1cece4.slice/crio-a50aedc2249ec11928cb02da0f602491df98881ffb3ad2f88cb2b1a5570c2ab0 WatchSource:0}: Error finding container a50aedc2249ec11928cb02da0f602491df98881ffb3ad2f88cb2b1a5570c2ab0: Status 404 returned error can't find the container with id a50aedc2249ec11928cb02da0f602491df98881ffb3ad2f88cb2b1a5570c2ab0
Jul 29 04:04:37.161031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.161009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-97qpv"]
Jul 29 04:04:37.163337 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:37.163313    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99b6074b_caea_4900_9ce6_34596a3df637.slice/crio-09cbdc8ce8c1ef2a153c2e115f33e94b28d89bbb7c519d72afe3c6f1c1098209 WatchSource:0}: Error finding container 09cbdc8ce8c1ef2a153c2e115f33e94b28d89bbb7c519d72afe3c6f1c1098209: Status 404 returned error can't find the container with id 09cbdc8ce8c1ef2a153c2e115f33e94b28d89bbb7c519d72afe3c6f1c1098209
Jul 29 04:04:37.501472 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.501438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6w5s" event={"ID":"1547b10b-9358-41ab-bd3d-67131ea01beb","Type":"ContainerStarted","Data":"b84a590da8bbc3e86beae0271329b7f4c8b34f1dc5d1072ad69051e56879a8fb"}
Jul 29 04:04:37.502579 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.502558    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8fx" event={"ID":"c1759f39-c5c2-4798-a020-b3585fe0867e","Type":"ContainerStarted","Data":"8a36c5c3aa98b4dcf35cb7b426d28efb38aa35a3b907be073408c7210dc40594"}
Jul 29 04:04:37.503544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.503522    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97qpv" event={"ID":"99b6074b-caea-4900-9ce6-34596a3df637","Type":"ContainerStarted","Data":"09cbdc8ce8c1ef2a153c2e115f33e94b28d89bbb7c519d72afe3c6f1c1098209"}
Jul 29 04:04:37.504813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.504790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mzg2n" event={"ID":"67dd538d-a783-4a71-9119-9bd80c1cece4","Type":"ContainerStarted","Data":"a28630ba2134107dbdafb62bae7567f170f5e0b28f64809c74455254c9a6ba81"}
Jul 29 04:04:37.504904 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.504825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mzg2n" event={"ID":"67dd538d-a783-4a71-9119-9bd80c1cece4","Type":"ContainerStarted","Data":"a50aedc2249ec11928cb02da0f602491df98881ffb3ad2f88cb2b1a5570c2ab0"}
Jul 29 04:04:37.504963 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.504925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:04:37.520915 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:37.520872    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mzg2n" podStartSLOduration=66.520859432 podStartE2EDuration="1m6.520859432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:37.519982174 +0000 UTC m=+67.794998962" watchObservedRunningTime="2026-07-29 04:04:37.520859432 +0000 UTC m=+67.795876219"
Jul 29 04:04:38.035028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.034995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:38.035184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035047    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:38.035184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035088    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:38.035184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:38.035184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:38.035407 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:38.035407 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:38.035933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.035905    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/36a75980-e622-410c-973f-a21cb2a908c4-service-ca-bundle\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:38.039186 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.039069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/36a75980-e622-410c-973f-a21cb2a908c4-metrics-certs\") pod \"router-default-5fb4f4744f-ltrx6\" (UID: \"36a75980-e622-410c-973f-a21cb2a908c4\") " pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:38.039186 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.039080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"image-registry-77948774df-tg6h4\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") " pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:38.039186 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.039069    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4be382cc-38f1-49f5-b828-d446fd08660e-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-mhl2z\" (UID: \"4be382cc-38f1-49f5-b828-d446fd08660e\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:38.039186 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.039144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0551bf59-fbf5-4bdf-80ed-1d05450f922e-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-7ph28\" (UID: \"0551bf59-fbf5-4bdf-80ed-1d05450f922e\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:38.039393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.039251    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/6d36f6db-3a79-4416-91f4-f1144977d617-metrics-tls\") pod \"dns-default-ks8v9\" (UID: \"6d36f6db-3a79-4416-91f4-f1144977d617\") " pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:38.041040 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.041005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/896876a8-2a55-4822-bab3-2dfbad6e5d99-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-xx4sg\" (UID: \"896876a8-2a55-4822-bab3-2dfbad6e5d99\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:38.264417 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.264211    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-qmdc2\""
Jul 29 04:04:38.271667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.271432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:38.287262 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.287201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-5dpr4\""
Jul 29 04:04:38.295045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.295026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"
Jul 29 04:04:38.298616 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.298590    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-6hcnc\""
Jul 29 04:04:38.307138 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.306858    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"
Jul 29 04:04:38.313279 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.313257    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-vmhjl\""
Jul 29 04:04:38.320370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.320348    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l4g4k\""
Jul 29 04:04:38.321671 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.321634    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:38.327716 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.327697    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7m6rk\""
Jul 29 04:04:38.328978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.328936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"
Jul 29 04:04:38.335607 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.335549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:38.496672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.496648    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:04:38.516877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.516787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77948774df-tg6h4" event={"ID":"1333f4c5-65d6-463c-acfb-fc254c797ece","Type":"ContainerStarted","Data":"cb5bb295b35fac3b844c7d8174e8c02b13d911e9dbd81a5db9e8d2bc51b0b75e"}
Jul 29 04:04:38.524135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.524112    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg"]
Jul 29 04:04:38.573987 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.573381    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-7ph28"]
Jul 29 04:04:38.594952 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.594918    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ks8v9"]
Jul 29 04:04:38.601274 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:38.601233    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d36f6db_3a79_4416_91f4_f1144977d617.slice/crio-9b8875b67d4ba1e0a22686bcbae54f0891c6b1ea8a129281bd2915ad85d37151 WatchSource:0}: Error finding container 9b8875b67d4ba1e0a22686bcbae54f0891c6b1ea8a129281bd2915ad85d37151: Status 404 returned error can't find the container with id 9b8875b67d4ba1e0a22686bcbae54f0891c6b1ea8a129281bd2915ad85d37151
Jul 29 04:04:38.658489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.658391    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z"]
Jul 29 04:04:38.684875 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:38.684720    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5fb4f4744f-ltrx6"]
Jul 29 04:04:38.688022 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:38.687990    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36a75980_e622_410c_973f_a21cb2a908c4.slice/crio-ab8eb662786f9abe4e125ccc78b1ca939762b4bd8503aa35790844c9e95987f0 WatchSource:0}: Error finding container ab8eb662786f9abe4e125ccc78b1ca939762b4bd8503aa35790844c9e95987f0: Status 404 returned error can't find the container with id ab8eb662786f9abe4e125ccc78b1ca939762b4bd8503aa35790844c9e95987f0
Jul 29 04:04:39.500691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.500653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:39.525719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.525687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ks8v9" event={"ID":"6d36f6db-3a79-4416-91f4-f1144977d617","Type":"ContainerStarted","Data":"9b8875b67d4ba1e0a22686bcbae54f0891c6b1ea8a129281bd2915ad85d37151"}
Jul 29 04:04:39.527868 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.527835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg" event={"ID":"896876a8-2a55-4822-bab3-2dfbad6e5d99","Type":"ContainerStarted","Data":"6e875e8b370a28f567b473f46a3af888b6858b3336c24ce7d5e71234e02f4e92"}
Jul 29 04:04:39.529520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.529489    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28" event={"ID":"0551bf59-fbf5-4bdf-80ed-1d05450f922e","Type":"ContainerStarted","Data":"d6d0965c5defe38be6815876a0b56f8722e81af0298d19eba9a941459470bf78"}
Jul 29 04:04:39.531898 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.531868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77948774df-tg6h4" event={"ID":"1333f4c5-65d6-463c-acfb-fc254c797ece","Type":"ContainerStarted","Data":"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"}
Jul 29 04:04:39.532403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.532047    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:04:39.533912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.533877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z" event={"ID":"4be382cc-38f1-49f5-b828-d446fd08660e","Type":"ContainerStarted","Data":"5bf9b0d1e6fe1310c7e262f2572325d744892b8887e110edfc9db3ec7efabe1f"}
Jul 29 04:04:39.536330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.535970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6" event={"ID":"36a75980-e622-410c-973f-a21cb2a908c4","Type":"ContainerStarted","Data":"e89bc168731e01832021750d2c20c2248b466bdf4a958e171b010408a9a701d3"}
Jul 29 04:04:39.536330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.536012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6" event={"ID":"36a75980-e622-410c-973f-a21cb2a908c4","Type":"ContainerStarted","Data":"ab8eb662786f9abe4e125ccc78b1ca939762b4bd8503aa35790844c9e95987f0"}
Jul 29 04:04:39.554412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.554369    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77948774df-tg6h4" podStartSLOduration=68.554351235 podStartE2EDuration="1m8.554351235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:39.553506631 +0000 UTC m=+69.828523421" watchObservedRunningTime="2026-07-29 04:04:39.554351235 +0000 UTC m=+69.829368026"
Jul 29 04:04:39.558723 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.558697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:39.571173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:39.571122    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6" podStartSLOduration=36.571106795 podStartE2EDuration="36.571106795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:39.571020055 +0000 UTC m=+69.846036844" watchObservedRunningTime="2026-07-29 04:04:39.571106795 +0000 UTC m=+69.846123648"
Jul 29 04:04:40.038538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.038504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:40.169531 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.169496    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:40.173831 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.173801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:04:40.203411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.203383    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.212064 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212039    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 04:04:40.212251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212231    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 04:04:40.212441 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212344    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pf6k9\""
Jul 29 04:04:40.212592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212496    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 04:04:40.212592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212579    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 04:04:40.212723 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212681    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 29 04:04:40.212869 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.212780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 04:04:40.213031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.213001    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 29 04:04:40.215132 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.214029    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-n26zc"]
Jul 29 04:04:40.255200 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.254419    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-n26zc"]
Jul 29 04:04:40.255200 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.254461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:04:40.255200 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.254561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:04:40.258659 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.258110    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-mv5bq\""
Jul 29 04:04:40.310794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.310704    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:40.322370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.322301    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:40.325526 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.325305    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:40.359445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359412    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359605 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359605 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5stc\" (UniqueName: \"kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359605 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.359796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.359670    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm52v\" (UniqueName: \"kubernetes.io/projected/7d7bf942-326b-4c52-ad16-d2b8e5912589-kube-api-access-zm52v\") pod \"downloads-7c97dc4555-n26zc\" (UID: \"7d7bf942-326b-4c52-ad16-d2b8e5912589\") " pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460429    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5stc\" (UniqueName: \"kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460572    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm52v\" (UniqueName: \"kubernetes.io/projected/7d7bf942-326b-4c52-ad16-d2b8e5912589-kube-api-access-zm52v\") pod \"downloads-7c97dc4555-n26zc\" (UID: \"7d7bf942-326b-4c52-ad16-d2b8e5912589\") " pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.460652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461540 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.461386    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.461656    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.461962 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.461933    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.470559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.470492    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.471652 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.471626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.473940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.473897    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm52v\" (UniqueName: \"kubernetes.io/projected/7d7bf942-326b-4c52-ad16-d2b8e5912589-kube-api-access-zm52v\") pod \"downloads-7c97dc4555-n26zc\" (UID: \"7d7bf942-326b-4c52-ad16-d2b8e5912589\") " pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:04:40.475557 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.475514    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5stc\" (UniqueName: \"kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc\") pod \"console-86d6fc8c9b-lr9jw\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") " pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.491812 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.491787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:40.520928 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.520900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:04:40.542735 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.542667    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:40.543490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.543471    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5fb4f4744f-ltrx6"
Jul 29 04:04:40.566244 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.566004    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:04:40.727579 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.727544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:40.787703 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:40.787673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.196454 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.196428    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:04:44.207725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.207699    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.209516 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.209487    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:04:44.210133 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.210106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.221191 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.221159    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 04:04:44.275980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.275939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.351141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.351084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.394209 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvqwt\" (UniqueName: \"kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394281    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394316    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394376    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.394646 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.394445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.454884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.454799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.495015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.494987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xvqwt\" (UniqueName: \"kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495171    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.495424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.496032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.495970    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.496168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.496043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.496168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.496127    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.496304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.496282    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.498079 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.498051    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.498252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.498227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.504082 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.504063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvqwt\" (UniqueName: \"kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt\") pod \"console-67f66974fd-427rq\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") " pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:44.519682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.519658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:44.521580 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:44.521559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:46.077794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:46.077734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:46.130031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:46.130006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:46.992357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:46.992319    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:04:46.999509 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:46.999177    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd5e529e_5be8_4baf_a543_2555fb1a7fb0.slice/crio-9bf6a90f283c18abcb8ee0531758721ee7848a0e3d97000d3d8c9603b3135488 WatchSource:0}: Error finding container 9bf6a90f283c18abcb8ee0531758721ee7848a0e3d97000d3d8c9603b3135488: Status 404 returned error can't find the container with id 9bf6a90f283c18abcb8ee0531758721ee7848a0e3d97000d3d8c9603b3135488
Jul 29 04:04:47.170357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.168977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-n26zc"]
Jul 29 04:04:47.181897 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:47.181864    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d7bf942_326b_4c52_ad16_d2b8e5912589.slice/crio-ceab31ac01180db04ab6cc48674a4b8d65c4c0e6932a53aed1e76a747919141b WatchSource:0}: Error finding container ceab31ac01180db04ab6cc48674a4b8d65c4c0e6932a53aed1e76a747919141b: Status 404 returned error can't find the container with id ceab31ac01180db04ab6cc48674a4b8d65c4c0e6932a53aed1e76a747919141b
Jul 29 04:04:47.195105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.193774    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:04:47.198473 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:04:47.198439    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc729e7_d855_4675_ab6b_ad6ed8c9fdfa.slice/crio-89e8f40dc508a840f5e4d6af5beaa63bdc428750dbcb9ba572f948db297f1ee8 WatchSource:0}: Error finding container 89e8f40dc508a840f5e4d6af5beaa63bdc428750dbcb9ba572f948db297f1ee8: Status 404 returned error can't find the container with id 89e8f40dc508a840f5e4d6af5beaa63bdc428750dbcb9ba572f948db297f1ee8
Jul 29 04:04:47.473869 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.473796    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:47.575794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.574152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:47.575794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.574345    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28" event={"ID":"0551bf59-fbf5-4bdf-80ed-1d05450f922e","Type":"ContainerStarted","Data":"5baf97332115aa02b9d8a3e9b7f956ac629a15203b64281ada444625551ec4f2"}
Jul 29 04:04:47.592022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.591986    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ks8v9" event={"ID":"6d36f6db-3a79-4416-91f4-f1144977d617","Type":"ContainerStarted","Data":"11f9938c7a9292f8874af5f706d24a5587fd53e6a9e91aeed517ee87dc08d685"}
Jul 29 04:04:47.592196 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.592050    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ks8v9" event={"ID":"6d36f6db-3a79-4416-91f4-f1144977d617","Type":"ContainerStarted","Data":"ab4973c8bf9198a40fbc14a0e39b5594cf15c86a45b245868873e83fb3671b75"}
Jul 29 04:04:47.592635 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.592611    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:47.595265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.595200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6fc8c9b-lr9jw" event={"ID":"fd5e529e-5be8-4baf-a543-2555fb1a7fb0","Type":"ContainerStarted","Data":"9bf6a90f283c18abcb8ee0531758721ee7848a0e3d97000d3d8c9603b3135488"}
Jul 29 04:04:47.599197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.599127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6w5s" event={"ID":"1547b10b-9358-41ab-bd3d-67131ea01beb","Type":"ContainerStarted","Data":"c5cdaa39d6067cf76172042fa41d8db4fad47be8c28a64217fe09ac705dc3550"}
Jul 29 04:04:47.601796 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.601731    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-7ph28" podStartSLOduration=36.190008165 podStartE2EDuration="44.601716339s" totalImagesPullingTime="8.411708174s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.601031154 +0000 UTC m=+77.876047943" watchObservedRunningTime="2026-07-29 04:04:47.601716339 +0000 UTC m=+77.876733106"
Jul 29 04:04:47.605147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.605093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66974fd-427rq" event={"ID":"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa","Type":"ContainerStarted","Data":"89e8f40dc508a840f5e4d6af5beaa63bdc428750dbcb9ba572f948db297f1ee8"}
Jul 29 04:04:47.609411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.608876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8fx" event={"ID":"c1759f39-c5c2-4798-a020-b3585fe0867e","Type":"ContainerStarted","Data":"0aaf6a7e60ff5e3c6797a6ec5606cfbd854e21af2b918e3d51040e3e21d67065"}
Jul 29 04:04:47.609411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.608920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-qg8fx" event={"ID":"c1759f39-c5c2-4798-a020-b3585fe0867e","Type":"ContainerStarted","Data":"6cc283df1b5b1530639c4f9fe61d075ecd8907fc0163b0924b31933471df68f8"}
Jul 29 04:04:47.616985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.616926    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-n26zc" event={"ID":"7d7bf942-326b-4c52-ad16-d2b8e5912589","Type":"ContainerStarted","Data":"ceab31ac01180db04ab6cc48674a4b8d65c4c0e6932a53aed1e76a747919141b"}
Jul 29 04:04:47.623295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.622896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-97qpv" event={"ID":"99b6074b-caea-4900-9ce6-34596a3df637","Type":"ContainerStarted","Data":"05cad89a7fbc39ae4eaa46d811c7e1a9e2e355f7f31a07abc88fec342aa5433c"}
Jul 29 04:04:47.633413 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.632907    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z" event={"ID":"4be382cc-38f1-49f5-b828-d446fd08660e","Type":"ContainerStarted","Data":"9bd18d6c82fb3050c14665ec3d6cbd6cc3a277a893e7bd72fc13fb29e86df3fb"}
Jul 29 04:04:47.633413 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.632949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z" event={"ID":"4be382cc-38f1-49f5-b828-d446fd08660e","Type":"ContainerStarted","Data":"eccc99b8ca671c2bf2889942d1d419453709df26406c6643ca81ed74d3d01d9f"}
Jul 29 04:04:47.637658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.637271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg" event={"ID":"896876a8-2a55-4822-bab3-2dfbad6e5d99","Type":"ContainerStarted","Data":"fd03dcf9dd6f83e931912131dedc71164c1e9b1bdd4af5e65ec51dc721fcc838"}
Jul 29 04:04:47.643373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.642709    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ks8v9" podStartSLOduration=33.257564094 podStartE2EDuration="41.642693168s" totalImagesPullingTime="8.385129074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.621276777 +0000 UTC m=+77.896293566" watchObservedRunningTime="2026-07-29 04:04:47.642693168 +0000 UTC m=+77.917709938"
Jul 29 04:04:47.647146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.647108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:47.661155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.660078    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-qg8fx" podStartSLOduration=67.850201156 podStartE2EDuration="1m16.660062406s" totalImagesPullingTime="8.80986125s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.643234012 +0000 UTC m=+77.918250801" watchObservedRunningTime="2026-07-29 04:04:47.660062406 +0000 UTC m=+77.935079195"
Jul 29 04:04:47.661155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.660374    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-97qpv" podStartSLOduration=66.820379749 podStartE2EDuration="1m16.660361185s" totalImagesPullingTime="9.839981436s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:03:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.659123212 +0000 UTC m=+77.934140006" watchObservedRunningTime="2026-07-29 04:04:47.660361185 +0000 UTC m=+77.935377974"
Jul 29 04:04:47.683078 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.682879    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-xx4sg" podStartSLOduration=36.234160174 podStartE2EDuration="44.682862693s" totalImagesPullingTime="8.448702519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.681010019 +0000 UTC m=+77.956026808" watchObservedRunningTime="2026-07-29 04:04:47.682862693 +0000 UTC m=+77.957879483"
Jul 29 04:04:47.720472 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.718829    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-mhl2z" podStartSLOduration=36.474552692 podStartE2EDuration="44.71881118s" totalImagesPullingTime="8.244258488s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:47.718449288 +0000 UTC m=+77.993466077" watchObservedRunningTime="2026-07-29 04:04:47.71881118 +0000 UTC m=+77.993827971"
Jul 29 04:04:47.771714 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.771621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:47.872888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.872798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:47.922300 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:47.922232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:48.404631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:48.404473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:48.999113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:48.999056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:49.050142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:49.050106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:49.558287 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:49.558246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:49.661302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:49.661223    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:50.570492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:50.569767    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:50.669598 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:50.669552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:52.152259 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:52.152226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:52.200626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:52.200560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:52.592758 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:52.592602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:52.644551 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:52.644486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:53.023102 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.023063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:53.678320 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.678275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6fc8c9b-lr9jw" event={"ID":"fd5e529e-5be8-4baf-a543-2555fb1a7fb0","Type":"ContainerStarted","Data":"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"}
Jul 29 04:04:53.681352 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.681293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l6w5s" event={"ID":"1547b10b-9358-41ab-bd3d-67131ea01beb","Type":"ContainerStarted","Data":"15a3f1a4935bbca11c1aa65ca9b63feb21901c47911d234411deaa45cc221b76"}
Jul 29 04:04:53.683621 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.683593    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66974fd-427rq" event={"ID":"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa","Type":"ContainerStarted","Data":"531bb45da2d3b8c2d24f8f09ec4aa660f5aeb1c7827e56dd333226fd1242f4c2"}
Jul 29 04:04:53.697906 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.697860    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-86d6fc8c9b-lr9jw" podStartSLOduration=7.182920208 podStartE2EDuration="13.697841961s" totalImagesPullingTime="6.514921753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:53.695736022 +0000 UTC m=+83.970752824" watchObservedRunningTime="2026-07-29 04:04:53.697841961 +0000 UTC m=+83.972858764"
Jul 29 04:04:53.732498 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.732447    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l6w5s" podStartSLOduration=16.756366878 podStartE2EDuration="37.732433699s" totalImagesPullingTime="20.976066821s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 04:04:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:53.732089517 +0000 UTC m=+84.007106307" watchObservedRunningTime="2026-07-29 04:04:53.732433699 +0000 UTC m=+84.007450487"
Jul 29 04:04:53.733468 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:53.733436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-67f66974fd-427rq" podStartSLOduration=3.409809756 podStartE2EDuration="9.733425831s" totalImagesPullingTime="6.323616075s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:04:53.716225576 +0000 UTC m=+83.991242365" watchObservedRunningTime="2026-07-29 04:04:53.733425831 +0000 UTC m=+84.008442619"
Jul 29 04:04:54.478641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.478601    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:54.522366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.522307    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:54.522553 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.522383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:54.527843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.527817    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:54.554394 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.554364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:54.622113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.622089    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:54.690624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.690587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:54.693302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.693280    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:04:54.748383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:54.748316    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:04:55.946676 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:55.946638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:57.998079 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:57.998027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:58.097408 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:58.097374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:58.527055 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:58.527023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:58.658108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:58.658079    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ks8v9"
Jul 29 04:04:58.995087 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:58.995012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:59.681919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:59.681886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:59.787476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:59.787401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:04:59.887732 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:04:59.887694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.019697 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.019653    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.055484 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.055447    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7k85j"]
Jul 29 04:05:00.059712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.059689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.061995 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.061976    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dqgcw\""
Jul 29 04:05:00.062116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.062016    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 29 04:05:00.062263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.062247    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 29 04:05:00.062960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.062938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 29 04:05:00.063074 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.062946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 29 04:05:00.117423 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.117384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.125466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-metrics-client-ca\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.125610 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-root\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.125824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-wtmp\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.125969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125855    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-tls\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.125969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8xwc6\" (UniqueName: \"kubernetes.io/projected/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-kube-api-access-8xwc6\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.125969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.125951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-textfile\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.126104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.126000    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.126104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.126024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.126104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.126069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-sys\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.214691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.214662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.227437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-metrics-client-ca\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-root\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-wtmp\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227512    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-tls\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227529    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8xwc6\" (UniqueName: \"kubernetes.io/projected/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-kube-api-access-8xwc6\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-textfile\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.227608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-sys\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-wtmp\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.227914    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-sys\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.228236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-textfile\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.228303    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-root\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.228459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-accelerators-collector-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.228709 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.228684    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-metrics-client-ca\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.230867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.230833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-tls\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.230975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.230899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.236400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.236379    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8xwc6\" (UniqueName: \"kubernetes.io/projected/de6dfa54-8009-4de8-bf94-b7bbefd83b1d-kube-api-access-8xwc6\") pod \"node-exporter-7k85j\" (UID: \"de6dfa54-8009-4de8-bf94-b7bbefd83b1d\") " pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.314962 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.314871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.370107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.370077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7k85j"
Jul 29 04:05:00.416125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.416088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.521034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.521003    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:05:00.521207 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.521152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:00.549288 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.549249    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:05:00.578672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:00.578572    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:01.036316 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:01.036267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:01.150738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:01.150694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:01.290124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:01.290035    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:01.580982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:01.580881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:02.985877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:02.985846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:03.000797 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:03.000768    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:05:03.170285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:03.170244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:03.400018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:03.399972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:03.500614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:03.500574    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:03.573949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:03.573901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:04.698106 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:04.698075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:04.807473 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:04.807430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:04.870647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:04.870585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:05.063692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:05.063641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:05.162101 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:05.162064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:05.262873 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:05.262839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:05.729921 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:05:05.729893    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde6dfa54_8009_4de8_bf94_b7bbefd83b1d.slice/crio-288f91230299651164521f149547bbcc53c9d79c250df52b0aa0823e375df9d5 WatchSource:0}: Error finding container 288f91230299651164521f149547bbcc53c9d79c250df52b0aa0823e375df9d5: Status 404 returned error can't find the container with id 288f91230299651164521f149547bbcc53c9d79c250df52b0aa0823e375df9d5
Jul 29 04:05:05.741297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:05.741270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k85j" event={"ID":"de6dfa54-8009-4de8-bf94-b7bbefd83b1d","Type":"ContainerStarted","Data":"288f91230299651164521f149547bbcc53c9d79c250df52b0aa0823e375df9d5"}
Jul 29 04:05:06.251447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:06.251365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:06.747615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:06.747580    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-n26zc" event={"ID":"7d7bf942-326b-4c52-ad16-d2b8e5912589","Type":"ContainerStarted","Data":"7ccb8cc793c679e15ab20f563fc3ebbc936c5e8b6b16fef53f05f6b7fc7ed3e3"}
Jul 29 04:05:06.748133 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:06.747788    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:05:06.762653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:06.762623    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-n26zc"
Jul 29 04:05:06.768068 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:06.767947    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-n26zc" podStartSLOduration=7.958605303 podStartE2EDuration="26.767932514s" totalImagesPullingTime="18.809327211s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:04:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:06.765287944 +0000 UTC m=+97.040304760" watchObservedRunningTime="2026-07-29 04:05:06.767932514 +0000 UTC m=+97.042949302"
Jul 29 04:05:07.754615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:07.754572    2578 generic.go:356] "Generic (PLEG): container finished" podID="de6dfa54-8009-4de8-bf94-b7bbefd83b1d" containerID="e574f5b7614700c7f0d26554b2be63f1681b56a574976723e0b1c4c8b651a700" exitCode=0
Jul 29 04:05:07.755097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:07.754663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k85j" event={"ID":"de6dfa54-8009-4de8-bf94-b7bbefd83b1d","Type":"ContainerDied","Data":"e574f5b7614700c7f0d26554b2be63f1681b56a574976723e0b1c4c8b651a700"}
Jul 29 04:05:07.778984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:07.778950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:08.036625 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:08.036598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:08.528224 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:08.528189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mzg2n"
Jul 29 04:05:08.762277 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:08.762235    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k85j" event={"ID":"de6dfa54-8009-4de8-bf94-b7bbefd83b1d","Type":"ContainerStarted","Data":"da3ca713e71ae4ee4a85525ae96f57a0344eb71b6e7b87fe03447e79ed223722"}
Jul 29 04:05:08.762732 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:08.762307    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7k85j" event={"ID":"de6dfa54-8009-4de8-bf94-b7bbefd83b1d","Type":"ContainerStarted","Data":"8ea020983e4941e2f257776fefe34ef38712f7d4581f5fbeedaf021c4de11412"}
Jul 29 04:05:08.779569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:08.779463    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7k85j" podStartSLOduration=7.45391503 podStartE2EDuration="8.779444423s" totalImagesPullingTime="1.22876874s" totalInitContainerRuntime="96.760653ms" isStatefulPod=true podCreationTimestamp="2026-07-29 04:05:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:05:08.778542678 +0000 UTC m=+99.053559478" watchObservedRunningTime="2026-07-29 04:05:08.779444423 +0000 UTC m=+99.054461212"
Jul 29 04:05:09.519865 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:09.519831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:09.620435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:09.620399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:10.112577 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:10.112544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:10.212862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:10.212819    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:15.699167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:15.699131    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:05:15.787354 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:15.787316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:15.842947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:15.842916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:16.777615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:16.777582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:16.878781 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:16.878720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:20.716062 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:20.716019    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-86d6fc8c9b-lr9jw" podUID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" containerName="console" containerID="cri-o://895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803" gracePeriod=15
Jul 29 04:05:21.484662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.484634    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:05:21.624816 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.624816 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624741    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.625017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.625017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624846    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f5stc\" (UniqueName: \"kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.625017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.625017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.624898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config\") pod \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\" (UID: \"fd5e529e-5be8-4baf-a543-2555fb1a7fb0\") "
Jul 29 04:05:21.625274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.625249    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:21.625274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.625248    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca" (OuterVolumeSpecName: "service-ca") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:21.625487 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.625458    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config" (OuterVolumeSpecName: "console-config") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:21.627217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.627193    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:21.627508 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.627485    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:21.627603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.627527    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc" (OuterVolumeSpecName: "kube-api-access-f5stc") pod "fd5e529e-5be8-4baf-a543-2555fb1a7fb0" (UID: "fd5e529e-5be8-4baf-a543-2555fb1a7fb0"). InnerVolumeSpecName "kube-api-access-f5stc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:05:21.725726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725687    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.725726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725717    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.725726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725726    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.725726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725735    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.726227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725784    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.726227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.725803    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f5stc\" (UniqueName: \"kubernetes.io/projected/fd5e529e-5be8-4baf-a543-2555fb1a7fb0-kube-api-access-f5stc\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:21.824103 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.824065    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" containerID="895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803" exitCode=0
Jul 29 04:05:21.824263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.824115    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-86d6fc8c9b-lr9jw"
Jul 29 04:05:21.824263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.824161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6fc8c9b-lr9jw" event={"ID":"fd5e529e-5be8-4baf-a543-2555fb1a7fb0","Type":"ContainerDied","Data":"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"}
Jul 29 04:05:21.824263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.824211    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-86d6fc8c9b-lr9jw" event={"ID":"fd5e529e-5be8-4baf-a543-2555fb1a7fb0","Type":"ContainerDied","Data":"9bf6a90f283c18abcb8ee0531758721ee7848a0e3d97000d3d8c9603b3135488"}
Jul 29 04:05:21.824263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.824232    2578 scope.go:117] "RemoveContainer" containerID="895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"
Jul 29 04:05:21.832784 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.832737    2578 scope.go:117] "RemoveContainer" containerID="895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"
Jul 29 04:05:21.833091 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:05:21.833071    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803\": container with ID starting with 895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803 not found: ID does not exist" containerID="895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"
Jul 29 04:05:21.833134 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.833100    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803"} err="failed to get container status \"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803\": rpc error: code = NotFound desc = could not find container \"895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803\": container with ID starting with 895510e3e5704982f48fb571f4c61121e179d6140eafb052086061a2cb9e2803 not found: ID does not exist"
Jul 29 04:05:21.844628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.844604    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:05:21.848126 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:21.848108    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-86d6fc8c9b-lr9jw"]
Jul 29 04:05:22.194158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:22.194126    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" path="/var/lib/kubelet/pods/fd5e529e-5be8-4baf-a543-2555fb1a7fb0/volumes"
Jul 29 04:05:24.503218 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:24.503186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:25.151631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:25.151596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:28.021534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.021491    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77948774df-tg6h4" podUID="1333f4c5-65d6-463c-acfb-fc254c797ece" containerName="registry" containerID="cri-o://90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4" gracePeriod=30
Jul 29 04:05:28.305811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.305784    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:05:28.483547 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483718 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483609    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483718 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483659    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483718 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483701    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ptgcf\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483730    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483785    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.483912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.483847    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") pod \"1333f4c5-65d6-463c-acfb-fc254c797ece\" (UID: \"1333f4c5-65d6-463c-acfb-fc254c797ece\") "
Jul 29 04:05:28.484275 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.484242    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:28.484411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.484270    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:28.486465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.486429    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:05:28.486569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.486489    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:05:28.486632 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.486569    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:28.486632 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.486617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf" (OuterVolumeSpecName: "kube-api-access-ptgcf") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "kube-api-access-ptgcf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:05:28.486739 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.486650    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:28.492294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.492263    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "1333f4c5-65d6-463c-acfb-fc254c797ece" (UID: "1333f4c5-65d6-463c-acfb-fc254c797ece"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585121    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-trusted-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585151    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ptgcf\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-kube-api-access-ptgcf\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585162    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-installation-pull-secrets\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585173    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1333f4c5-65d6-463c-acfb-fc254c797ece-image-registry-private-configuration\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585183    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-certificates\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585191    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-registry-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585201    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1333f4c5-65d6-463c-acfb-fc254c797ece-bound-sa-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.585199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.585208    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1333f4c5-65d6-463c-acfb-fc254c797ece-ca-trust-extracted\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:28.856533 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.856451    2578 generic.go:356] "Generic (PLEG): container finished" podID="1333f4c5-65d6-463c-acfb-fc254c797ece" containerID="90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4" exitCode=0
Jul 29 04:05:28.856763 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.856712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77948774df-tg6h4" event={"ID":"1333f4c5-65d6-463c-acfb-fc254c797ece","Type":"ContainerDied","Data":"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"}
Jul 29 04:05:28.856880 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.856860    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77948774df-tg6h4"
Jul 29 04:05:28.856963 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.856901    2578 scope.go:117] "RemoveContainer" containerID="90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"
Jul 29 04:05:28.857020 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.856804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77948774df-tg6h4" event={"ID":"1333f4c5-65d6-463c-acfb-fc254c797ece","Type":"ContainerDied","Data":"cb5bb295b35fac3b844c7d8174e8c02b13d911e9dbd81a5db9e8d2bc51b0b75e"}
Jul 29 04:05:28.869268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.869251    2578 scope.go:117] "RemoveContainer" containerID="90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"
Jul 29 04:05:28.869528 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:05:28.869509    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4\": container with ID starting with 90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4 not found: ID does not exist" containerID="90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"
Jul 29 04:05:28.869574 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.869536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4"} err="failed to get container status \"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4\": rpc error: code = NotFound desc = could not find container \"90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4\": container with ID starting with 90dd31180c744a1d33c6124aff516e728902720d90e26526656ff53e642f33d4 not found: ID does not exist"
Jul 29 04:05:28.879680 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.879658    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:05:28.883452 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:28.883433    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77948774df-tg6h4"]
Jul 29 04:05:30.196016 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:30.195986    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1333f4c5-65d6-463c-acfb-fc254c797ece" path="/var/lib/kubelet/pods/1333f4c5-65d6-463c-acfb-fc254c797ece/volumes"
Jul 29 04:05:30.865968 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:30.865936    2578 generic.go:356] "Generic (PLEG): container finished" podID="2702597e-99c7-4f44-8cb2-c9ee052dc112" containerID="cd25434b1be59c5144fa8a59ac500cf8d57597e35c31d1d95c252ceaede2efcd" exitCode=0
Jul 29 04:05:30.866135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:30.865997    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-sg5z7" event={"ID":"2702597e-99c7-4f44-8cb2-c9ee052dc112","Type":"ContainerDied","Data":"cd25434b1be59c5144fa8a59ac500cf8d57597e35c31d1d95c252ceaede2efcd"}
Jul 29 04:05:30.866380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:30.866364    2578 scope.go:117] "RemoveContainer" containerID="cd25434b1be59c5144fa8a59ac500cf8d57597e35c31d1d95c252ceaede2efcd"
Jul 29 04:05:31.613334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:31.613293    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fb4f4744f-ltrx6_36a75980-e622-410c-973f-a21cb2a908c4/router/0.log"
Jul 29 04:05:31.647189 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:31.647161    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-64qnw_4aabdd1e-2246-4a06-9a94-227a7a9d8e2f/serve-healthcheck-canary/0.log"
Jul 29 04:05:31.677024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:31.676990    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:31.774801 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:31.774771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:31.876771 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:31.876644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-sg5z7" event={"ID":"2702597e-99c7-4f44-8cb2-c9ee052dc112","Type":"ContainerStarted","Data":"337227071cdbd33baf5f04f503caf615b69fbac1a4cbba01a0a32dcd858993e8"}
Jul 29 04:05:35.893719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:35.893688    2578 generic.go:356] "Generic (PLEG): container finished" podID="19886b27-424c-47bf-b46c-6a0ef0c38420" containerID="770500c590210e115ffee06938a9ec669dfb75492d93374e8bff12a8fdb8ee42" exitCode=0
Jul 29 04:05:35.894130 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:35.893724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn" event={"ID":"19886b27-424c-47bf-b46c-6a0ef0c38420","Type":"ContainerDied","Data":"770500c590210e115ffee06938a9ec669dfb75492d93374e8bff12a8fdb8ee42"}
Jul 29 04:05:35.894130 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:35.894052    2578 scope.go:117] "RemoveContainer" containerID="770500c590210e115ffee06938a9ec669dfb75492d93374e8bff12a8fdb8ee42"
Jul 29 04:05:36.899673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:36.899639    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-twnrn" event={"ID":"19886b27-424c-47bf-b46c-6a0ef0c38420","Type":"ContainerStarted","Data":"5fb5e01d1e7828bdf000f74751a6150fddc55354bf2564e6083ec1bbf4dcc6de"}
Jul 29 04:05:39.501923 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:39.501885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:39.555305 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:39.555274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:05:40.719877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.719783    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-67f66974fd-427rq" podUID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" containerName="console" containerID="cri-o://531bb45da2d3b8c2d24f8f09ec4aa660f5aeb1c7827e56dd333226fd1242f4c2" gracePeriod=15
Jul 29 04:05:40.917469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.917434    2578 generic.go:356] "Generic (PLEG): container finished" podID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" containerID="531bb45da2d3b8c2d24f8f09ec4aa660f5aeb1c7827e56dd333226fd1242f4c2" exitCode=0
Jul 29 04:05:40.917636 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.917512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66974fd-427rq" event={"ID":"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa","Type":"ContainerDied","Data":"531bb45da2d3b8c2d24f8f09ec4aa660f5aeb1c7827e56dd333226fd1242f4c2"}
Jul 29 04:05:40.919138 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.919110    2578 generic.go:356] "Generic (PLEG): container finished" podID="fc55f329-db6f-407b-a0ee-6a643ea4d03d" containerID="8710566c68276604b70e36fe2287c59ce9185161fa1632591def79cfb822c176" exitCode=0
Jul 29 04:05:40.919322 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.919158    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds" event={"ID":"fc55f329-db6f-407b-a0ee-6a643ea4d03d","Type":"ContainerDied","Data":"8710566c68276604b70e36fe2287c59ce9185161fa1632591def79cfb822c176"}
Jul 29 04:05:40.919702 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:40.919480    2578 scope.go:117] "RemoveContainer" containerID="8710566c68276604b70e36fe2287c59ce9185161fa1632591def79cfb822c176"
Jul 29 04:05:41.038423 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.038389    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:05:41.071821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.071795    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.071977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.071834    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.071977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.071859    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.071977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.071895    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xvqwt\" (UniqueName: \"kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.072265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072149    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.072265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072208    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.072265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072223    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:41.072490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072293    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca\") pod \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\" (UID: \"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa\") "
Jul 29 04:05:41.072544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072514    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.072607 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072575    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config" (OuterVolumeSpecName: "console-config") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:41.072717 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:41.072863 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.072840    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca" (OuterVolumeSpecName: "service-ca") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:05:41.074515 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.074491    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:41.074616 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.074544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt" (OuterVolumeSpecName: "kube-api-access-xvqwt") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "kube-api-access-xvqwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:05:41.074873 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.074849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" (UID: "4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:05:41.173256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173215    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.173256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173247    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.173256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173256    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.173256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173264    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xvqwt\" (UniqueName: \"kubernetes.io/projected/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-kube-api-access-xvqwt\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.173503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173274    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.173503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.173282    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:05:41.924450 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.924422    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-67f66974fd-427rq"
Jul 29 04:05:41.924911 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.924452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-67f66974fd-427rq" event={"ID":"4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa","Type":"ContainerDied","Data":"89e8f40dc508a840f5e4d6af5beaa63bdc428750dbcb9ba572f948db297f1ee8"}
Jul 29 04:05:41.924911 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.924513    2578 scope.go:117] "RemoveContainer" containerID="531bb45da2d3b8c2d24f8f09ec4aa660f5aeb1c7827e56dd333226fd1242f4c2"
Jul 29 04:05:41.926639 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.926615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds" event={"ID":"fc55f329-db6f-407b-a0ee-6a643ea4d03d","Type":"ContainerStarted","Data":"a6ab3b68a05e90b9301d44e2a3446c35e3997a5fad8eeb7244a7382fccd30bcf"}
Jul 29 04:05:41.958632 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.958599    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:05:41.963210 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:41.963181    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-67f66974fd-427rq"]
Jul 29 04:05:42.194662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:05:42.194578    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" path="/var/lib/kubelet/pods/4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa/volumes"
Jul 29 04:06:19.240453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:19.240418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:19.655197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:19.655162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:24.311287 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311209    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"]
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311514    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1333f4c5-65d6-463c-acfb-fc254c797ece" containerName="registry"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311525    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1333f4c5-65d6-463c-acfb-fc254c797ece" containerName="registry"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311547    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311552    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311562    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311572    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311623    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bc729e7-d855-4675-ab6b-ad6ed8c9fdfa" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311632    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd5e529e-5be8-4baf-a543-2555fb1a7fb0" containerName="console"
Jul 29 04:06:24.311692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.311640    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1333f4c5-65d6-463c-acfb-fc254c797ece" containerName="registry"
Jul 29 04:06:24.313691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.313674    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.316889 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.316864    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 29 04:06:24.316889 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.316902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 29 04:06:24.317147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.316902    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 29 04:06:24.317147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.317013    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 29 04:06:24.317147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.317035    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-dkcjt\""
Jul 29 04:06:24.317147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.317038    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 29 04:06:24.321882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.321865    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 29 04:06:24.326529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.326509    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"]
Jul 29 04:06:24.383059 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vfrjz\" (UniqueName: \"kubernetes.io/projected/c3576584-23a0-426c-9c60-36a2606453cc-kube-api-access-vfrjz\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-serving-certs-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383213    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383233    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-federate-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383338 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-metrics-client-ca\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.383338 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.383299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-metrics-client-ca\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vfrjz\" (UniqueName: \"kubernetes.io/projected/c3576584-23a0-426c-9c60-36a2606453cc-kube-api-access-vfrjz\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-serving-certs-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484551    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.484738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.484579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-federate-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.485247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.485221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-metrics-client-ca\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.485365 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.485221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-serving-certs-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.485583 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.485558    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.486969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.486944    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.487056 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.487024    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.487311 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.487290    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-telemeter-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.487347 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.487302    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/c3576584-23a0-426c-9c60-36a2606453cc-federate-client-tls\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.493128 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.493105    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vfrjz\" (UniqueName: \"kubernetes.io/projected/c3576584-23a0-426c-9c60-36a2606453cc-kube-api-access-vfrjz\") pod \"telemeter-client-6877c5dbd6-qddrz\" (UID: \"c3576584-23a0-426c-9c60-36a2606453cc\") " pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.623968 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.623888    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"
Jul 29 04:06:24.749542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:24.749354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6877c5dbd6-qddrz"]
Jul 29 04:06:24.751651 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:06:24.751624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3576584_23a0_426c_9c60_36a2606453cc.slice/crio-cd68e95a4254929fb2c4b1f26d78322002116ed95c08a9ce9605e3fd7aaea4b3 WatchSource:0}: Error finding container cd68e95a4254929fb2c4b1f26d78322002116ed95c08a9ce9605e3fd7aaea4b3: Status 404 returned error can't find the container with id cd68e95a4254929fb2c4b1f26d78322002116ed95c08a9ce9605e3fd7aaea4b3
Jul 29 04:06:25.081721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:25.081685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz" event={"ID":"c3576584-23a0-426c-9c60-36a2606453cc","Type":"ContainerStarted","Data":"cd68e95a4254929fb2c4b1f26d78322002116ed95c08a9ce9605e3fd7aaea4b3"}
Jul 29 04:06:27.089991 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:27.089956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz" event={"ID":"c3576584-23a0-426c-9c60-36a2606453cc","Type":"ContainerStarted","Data":"37fb45b4bf2cb627a87aafc259ee895eef1e48f8eb79b4b68be90305507e8fb4"}
Jul 29 04:06:28.096024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:28.095993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz" event={"ID":"c3576584-23a0-426c-9c60-36a2606453cc","Type":"ContainerStarted","Data":"bf280d8908831fc176dcf804edf8f69b7d1ea2a90b3007898cf46f16521b00d7"}
Jul 29 04:06:28.096375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:28.096048    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz" event={"ID":"c3576584-23a0-426c-9c60-36a2606453cc","Type":"ContainerStarted","Data":"8a0cd6de568958b523dec85a98e2f274e0d0b17fdc5736771f39a8db88c374f8"}
Jul 29 04:06:28.119777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:28.119715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6877c5dbd6-qddrz" podStartSLOduration=1.283796612 podStartE2EDuration="4.119700381s" totalImagesPullingTime="2.835903769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:06:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:06:28.117214949 +0000 UTC m=+178.392231736" watchObservedRunningTime="2026-07-29 04:06:28.119700381 +0000 UTC m=+178.394717169"
Jul 29 04:06:29.084876 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.084841    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:06:29.088635 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.088318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.091642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.091602    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 29 04:06:29.091789 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.091640    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 29 04:06:29.091861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.091837    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 29 04:06:29.092701 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.092682    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 29 04:06:29.093261 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.093244    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 29 04:06:29.093408 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.093353    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-pf6k9\""
Jul 29 04:06:29.097580 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.097353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:06:29.098798 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.098776    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 29 04:06:29.136471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.136444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:29.220054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.220470 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.220445    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpzmc\" (UniqueName: \"kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.237617 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.237581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:29.320882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.320843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.320882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.320884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.320908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.320945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.320989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpzmc\" (UniqueName: \"kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321086    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321649    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321702    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321710    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.321900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.321856    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.324141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.324112    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.324226 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.324122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.328828 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.328807    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpzmc\" (UniqueName: \"kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc\") pod \"console-c6fd4dbd9-qsp58\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") " pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.337525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.337465    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:29.386619 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.386597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:29.403614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.403592    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:29.529759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.529690    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:06:29.532207 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:06:29.532181    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3189f6e9_327d_41b2_b129_40b03da94df3.slice/crio-9a8b49608d373625dc9af08956d609f5b3fb93b31d9f3c8780a06acb1b5c3131 WatchSource:0}: Error finding container 9a8b49608d373625dc9af08956d609f5b3fb93b31d9f3c8780a06acb1b5c3131: Status 404 returned error can't find the container with id 9a8b49608d373625dc9af08956d609f5b3fb93b31d9f3c8780a06acb1b5c3131
Jul 29 04:06:29.889910 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.889877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:29.952172 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:29.952143    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:30.106966 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:30.106935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fd4dbd9-qsp58" event={"ID":"3189f6e9-327d-41b2-b129-40b03da94df3","Type":"ContainerStarted","Data":"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"}
Jul 29 04:06:30.107304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:30.106985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fd4dbd9-qsp58" event={"ID":"3189f6e9-327d-41b2-b129-40b03da94df3","Type":"ContainerStarted","Data":"9a8b49608d373625dc9af08956d609f5b3fb93b31d9f3c8780a06acb1b5c3131"}
Jul 29 04:06:30.123687 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:30.123640    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c6fd4dbd9-qsp58" podStartSLOduration=1.123624869 podStartE2EDuration="1.123624869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:06:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:06:30.123172679 +0000 UTC m=+180.398189472" watchObservedRunningTime="2026-07-29 04:06:30.123624869 +0000 UTC m=+180.398641722"
Jul 29 04:06:34.484488 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:34.484447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:34.549034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:34.548999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:34.729030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:34.728989    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:39.403763 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:39.403710    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:39.404151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:39.403816    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:39.408538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:39.408512    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:40.147684 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.147654    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:06:40.253913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.253880    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6599cfc7c8-gdctw"]
Jul 29 04:06:40.259894 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.259845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.269013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.268986    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6599cfc7c8-gdctw"]
Jul 29 04:06:40.403660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-service-ca\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.403660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403624    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-oauth-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.403660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.404091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403691    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-trusted-ca-bundle\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.404091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-42kvv\" (UniqueName: \"kubernetes.io/projected/40bab232-d8bf-47e0-9d03-6ec10222cdeb-kube-api-access-42kvv\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.404091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-oauth-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.404091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.403835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505016 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.504987    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-service-ca\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505022    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-oauth-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-trusted-ca-bundle\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-42kvv\" (UniqueName: \"kubernetes.io/projected/40bab232-d8bf-47e0-9d03-6ec10222cdeb-kube-api-access-42kvv\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-oauth-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505771 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-service-ca\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.505986 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.505958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-oauth-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.506081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.506021    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.506081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.506057    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bab232-d8bf-47e0-9d03-6ec10222cdeb-trusted-ca-bundle\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.507584 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.507553    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-oauth-config\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.507742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.507727    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/40bab232-d8bf-47e0-9d03-6ec10222cdeb-console-serving-cert\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.512830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.512812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-42kvv\" (UniqueName: \"kubernetes.io/projected/40bab232-d8bf-47e0-9d03-6ec10222cdeb-kube-api-access-42kvv\") pod \"console-6599cfc7c8-gdctw\" (UID: \"40bab232-d8bf-47e0-9d03-6ec10222cdeb\") " pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.571248 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.571228    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:40.654651 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.654546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:40.707248 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.707171    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6599cfc7c8-gdctw"]
Jul 29 04:06:40.709132 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:40.709108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:40.710084 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:06:40.710061    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bab232_d8bf_47e0_9d03_6ec10222cdeb.slice/crio-97f5cdd475cd50c6fd02e9dc48d2bfed76d9025eb8d87969c2041b5931a26fb2 WatchSource:0}: Error finding container 97f5cdd475cd50c6fd02e9dc48d2bfed76d9025eb8d87969c2041b5931a26fb2: Status 404 returned error can't find the container with id 97f5cdd475cd50c6fd02e9dc48d2bfed76d9025eb8d87969c2041b5931a26fb2
Jul 29 04:06:41.149332 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:41.149295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599cfc7c8-gdctw" event={"ID":"40bab232-d8bf-47e0-9d03-6ec10222cdeb","Type":"ContainerStarted","Data":"acad5645fcab5c8bcb7b047ea72ce076838a5d5a81594b0c5d820bace16fe061"}
Jul 29 04:06:41.149520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:41.149349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6599cfc7c8-gdctw" event={"ID":"40bab232-d8bf-47e0-9d03-6ec10222cdeb","Type":"ContainerStarted","Data":"97f5cdd475cd50c6fd02e9dc48d2bfed76d9025eb8d87969c2041b5931a26fb2"}
Jul 29 04:06:41.165564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:41.165518    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6599cfc7c8-gdctw" podStartSLOduration=1.165503714 podStartE2EDuration="1.165503714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:06:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:06:41.16485464 +0000 UTC m=+191.439871427" watchObservedRunningTime="2026-07-29 04:06:41.165503714 +0000 UTC m=+191.440520558"
Jul 29 04:06:41.233189 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:41.233140    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:41.280965 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:41.280943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:46.369821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:46.369788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:46.470288 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:46.470250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:50.571352 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:50.571320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:50.571777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:50.571396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:50.576181 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:50.576155    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:51.190999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:51.190975    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6599cfc7c8-gdctw"
Jul 29 04:06:51.235991 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:51.235965    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:06:51.362613 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:51.362552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:51.411964 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:51.411933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:51.476695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:51.476630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:54.504411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:54.504381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:06:54.604486 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:06:54.604447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:01.640222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:01.640182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:16.257971 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.257931    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c6fd4dbd9-qsp58" podUID="3189f6e9-327d-41b2-b129-40b03da94df3" containerName="console" containerID="cri-o://a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2" gracePeriod=15
Jul 29 04:07:16.494541 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.494516    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:07:16.565920 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.565896    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.565945    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.565962    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.565983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566307 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566063    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566307 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jpzmc\" (UniqueName: \"kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc\") pod \"3189f6e9-327d-41b2-b129-40b03da94df3\" (UID: \"3189f6e9-327d-41b2-b129-40b03da94df3\") "
Jul 29 04:07:16.566307 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566280    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config" (OuterVolumeSpecName: "console-config") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:16.566520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566300    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca" (OuterVolumeSpecName: "service-ca") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:16.566520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566394    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:16.566604 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.566510    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:07:16.568069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.568045    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:07:16.568129 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.568102    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc" (OuterVolumeSpecName: "kube-api-access-jpzmc") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "kube-api-access-jpzmc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:07:16.568214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.568194    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3189f6e9-327d-41b2-b129-40b03da94df3" (UID: "3189f6e9-327d-41b2-b129-40b03da94df3"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:07:16.666592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666565    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jpzmc\" (UniqueName: \"kubernetes.io/projected/3189f6e9-327d-41b2-b129-40b03da94df3-kube-api-access-jpzmc\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666587    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666592 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666596    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-console-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666606    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-oauth-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666614    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-serving-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666622    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3189f6e9-327d-41b2-b129-40b03da94df3-console-oauth-config\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:16.666824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:16.666630    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3189f6e9-327d-41b2-b129-40b03da94df3-trusted-ca-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:17.278878 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.278843    2578 generic.go:356] "Generic (PLEG): container finished" podID="3189f6e9-327d-41b2-b129-40b03da94df3" containerID="a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2" exitCode=0
Jul 29 04:07:17.279252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.278887    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c6fd4dbd9-qsp58"
Jul 29 04:07:17.279252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.278912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fd4dbd9-qsp58" event={"ID":"3189f6e9-327d-41b2-b129-40b03da94df3","Type":"ContainerDied","Data":"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"}
Jul 29 04:07:17.279252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.278958    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c6fd4dbd9-qsp58" event={"ID":"3189f6e9-327d-41b2-b129-40b03da94df3","Type":"ContainerDied","Data":"9a8b49608d373625dc9af08956d609f5b3fb93b31d9f3c8780a06acb1b5c3131"}
Jul 29 04:07:17.279252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.278983    2578 scope.go:117] "RemoveContainer" containerID="a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"
Jul 29 04:07:17.289473 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.289450    2578 scope.go:117] "RemoveContainer" containerID="a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"
Jul 29 04:07:17.295007 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:07:17.294979    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2\": container with ID starting with a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2 not found: ID does not exist" containerID="a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"
Jul 29 04:07:17.295150 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.295014    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2"} err="failed to get container status \"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2\": rpc error: code = NotFound desc = could not find container \"a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2\": container with ID starting with a3e786b2140041e8411be8147c9d7c94af024924f775d679106efc45bced15c2 not found: ID does not exist"
Jul 29 04:07:17.304000 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.303978    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:07:17.307393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:17.307373    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c6fd4dbd9-qsp58"]
Jul 29 04:07:18.194183 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:18.194154    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3189f6e9-327d-41b2-b129-40b03da94df3" path="/var/lib/kubelet/pods/3189f6e9-327d-41b2-b129-40b03da94df3/volumes"
Jul 29 04:07:37.566798 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:37.566766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:37.665277 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:37.665234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:38.245822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.245792    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"]
Jul 29 04:07:38.246045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.246033    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3189f6e9-327d-41b2-b129-40b03da94df3" containerName="console"
Jul 29 04:07:38.246092 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.246046    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3189f6e9-327d-41b2-b129-40b03da94df3" containerName="console"
Jul 29 04:07:38.246148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.246107    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3189f6e9-327d-41b2-b129-40b03da94df3" containerName="console"
Jul 29 04:07:38.248492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.248476    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.251110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.251086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 04:07:38.251240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.251172    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 04:07:38.252240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.252216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6ppf\""
Jul 29 04:07:38.257137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.257117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"]
Jul 29 04:07:38.313633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.313609    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.313730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.313635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.313730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.313656    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ctfb\" (UniqueName: \"kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.414312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.414276    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.414312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.414315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.414498 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.414334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ctfb\" (UniqueName: \"kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.414695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.414675    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.414783 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.414701    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.422013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.421994    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ctfb\" (UniqueName: \"kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.558327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.558304    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:38.677414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:38.677345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"]
Jul 29 04:07:38.680154 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:07:38.680126    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3dfb1765_bb71_4fcf_85ae_59017d7bc9d8.slice/crio-5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688 WatchSource:0}: Error finding container 5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688: Status 404 returned error can't find the container with id 5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688
Jul 29 04:07:39.358933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:39.358890    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h" event={"ID":"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8","Type":"ContainerStarted","Data":"5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688"}
Jul 29 04:07:45.384500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:45.384441    2578 generic.go:356] "Generic (PLEG): container finished" podID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerID="57fbbb894e87bb3ffe06f7f00e9d88b4219058518dfa0526048f1444de16cc32" exitCode=0
Jul 29 04:07:45.384808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:45.384512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h" event={"ID":"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8","Type":"ContainerDied","Data":"57fbbb894e87bb3ffe06f7f00e9d88b4219058518dfa0526048f1444de16cc32"}
Jul 29 04:07:47.394342 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:47.394312    2578 generic.go:356] "Generic (PLEG): container finished" podID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerID="d288fc874345b3adb07a6d84b93e489d25e35282c7975ffd20e890247eccd0b6" exitCode=0
Jul 29 04:07:47.394636 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:47.394381    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h" event={"ID":"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8","Type":"ContainerDied","Data":"d288fc874345b3adb07a6d84b93e489d25e35282c7975ffd20e890247eccd0b6"}
Jul 29 04:07:52.205567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:52.205520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:52.791462 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:52.791363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:52.840872 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:52.840834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:54.425934 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:54.425899    2578 generic.go:356] "Generic (PLEG): container finished" podID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerID="5c62168d655d459abcabe7dd37a8b1c93ed1ee85716dd9e0ebbfdd0d1ad0d69f" exitCode=0
Jul 29 04:07:54.426385 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:54.425944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h" event={"ID":"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8","Type":"ContainerDied","Data":"5c62168d655d459abcabe7dd37a8b1c93ed1ee85716dd9e0ebbfdd0d1ad0d69f"}
Jul 29 04:07:55.552529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.552505    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:55.654184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.654161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util\") pod \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") "
Jul 29 04:07:55.654324 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.654216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ctfb\" (UniqueName: \"kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb\") pod \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") "
Jul 29 04:07:55.654324 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.654239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle\") pod \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\" (UID: \"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8\") "
Jul 29 04:07:55.654900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.654877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle" (OuterVolumeSpecName: "bundle") pod "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" (UID: "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:07:55.656365 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.656340    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb" (OuterVolumeSpecName: "kube-api-access-2ctfb") pod "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" (UID: "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8"). InnerVolumeSpecName "kube-api-access-2ctfb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:07:55.659310 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.659286    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util" (OuterVolumeSpecName: "util") pod "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" (UID: "3dfb1765-bb71-4fcf-85ae-59017d7bc9d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:07:55.755030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.754985    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:55.755030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.755004    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ctfb\" (UniqueName: \"kubernetes.io/projected/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-kube-api-access-2ctfb\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:55.755030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:55.755014    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3dfb1765-bb71-4fcf-85ae-59017d7bc9d8-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:07:56.434844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:56.434815    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h"
Jul 29 04:07:56.434844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:56.434831    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540klz8h" event={"ID":"3dfb1765-bb71-4fcf-85ae-59017d7bc9d8","Type":"ContainerDied","Data":"5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688"}
Jul 29 04:07:56.435037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:56.434893    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5cebea3cd739a08f010cc16969c53a6e61d20991c825825f610f79143223a688"
Jul 29 04:07:59.243193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:59.243159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:07:59.571183 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:07:59.571149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:00.040739 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:00.040709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:00.132369 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:00.132339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:01.347882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.347850    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"]
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348132    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="extract"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348147    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="extract"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348160    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="pull"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348165    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="pull"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348177    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="util"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348181    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="util"
Jul 29 04:08:01.348249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.348232    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3dfb1765-bb71-4fcf-85ae-59017d7bc9d8" containerName="extract"
Jul 29 04:08:01.381002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.380965    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"]
Jul 29 04:08:01.381146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.381063    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.384321 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.384285    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:08:01.384603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.384573    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 29 04:08:01.384735 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.384668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wqppg\""
Jul 29 04:08:01.504010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.503978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6dxr\" (UniqueName: \"kubernetes.io/projected/a12661c1-c085-4c62-a8d8-9c98475f0d2b-kube-api-access-s6dxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.504197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.504079    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a12661c1-c085-4c62-a8d8-9c98475f0d2b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.605161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.605066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a12661c1-c085-4c62-a8d8-9c98475f0d2b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.605161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.605147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6dxr\" (UniqueName: \"kubernetes.io/projected/a12661c1-c085-4c62-a8d8-9c98475f0d2b-kube-api-access-s6dxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.605455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.605432    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a12661c1-c085-4c62-a8d8-9c98475f0d2b-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.613331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.613307    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6dxr\" (UniqueName: \"kubernetes.io/projected/a12661c1-c085-4c62-a8d8-9c98475f0d2b-kube-api-access-s6dxr\") pod \"cert-manager-operator-controller-manager-55c444bf86-mt45b\" (UID: \"a12661c1-c085-4c62-a8d8-9c98475f0d2b\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.695248 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.695210    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"
Jul 29 04:08:01.841567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:01.841521    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b"]
Jul 29 04:08:01.843810 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:01.843780    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda12661c1_c085_4c62_a8d8_9c98475f0d2b.slice/crio-a1090d8c4816edb6d4b52315b79448cb38286c3b517561a772326963c1adb44c WatchSource:0}: Error finding container a1090d8c4816edb6d4b52315b79448cb38286c3b517561a772326963c1adb44c: Status 404 returned error can't find the container with id a1090d8c4816edb6d4b52315b79448cb38286c3b517561a772326963c1adb44c
Jul 29 04:08:02.458762 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:02.458718    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b" event={"ID":"a12661c1-c085-4c62-a8d8-9c98475f0d2b","Type":"ContainerStarted","Data":"a1090d8c4816edb6d4b52315b79448cb38286c3b517561a772326963c1adb44c"}
Jul 29 04:08:03.017009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:03.016978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:03.069147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:03.069116    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:04.469289 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:04.469250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b" event={"ID":"a12661c1-c085-4c62-a8d8-9c98475f0d2b","Type":"ContainerStarted","Data":"207c80aa7fded1f32c5bf9e4f78367e6d44e9504a05c1044bd77d0b4ffbcba89"}
Jul 29 04:08:04.489695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:04.489629    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-mt45b" podStartSLOduration=1.489978973 podStartE2EDuration="3.489610102s" totalImagesPullingTime="1.999631129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:04.487870559 +0000 UTC m=+274.762887346" watchObservedRunningTime="2026-07-29 04:08:04.489610102 +0000 UTC m=+274.764626891"
Jul 29 04:08:04.618560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:04.618527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:04.717638 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:04.717607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:04.882125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:04.882091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:05.032742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.032713    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:05.086356 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.086314    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qcmg"]
Jul 29 04:08:05.098098 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.098075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.101087 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.101064    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-k4pgl\""
Jul 29 04:08:05.101231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.101110    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 29 04:08:05.101280 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.101235    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 29 04:08:05.111418 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.111396    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qcmg"]
Jul 29 04:08:05.234158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.234075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.234158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.234117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6sphw\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-kube-api-access-6sphw\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.335821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.335792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.335999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.335850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6sphw\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-kube-api-access-6sphw\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.343838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.343814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.344010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.343992    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6sphw\" (UniqueName: \"kubernetes.io/projected/eec03fcf-4b8a-40a4-914b-87247ac4b8d2-kube-api-access-6sphw\") pod \"cert-manager-webhook-6486ffd997-4qcmg\" (UID: \"eec03fcf-4b8a-40a4-914b-87247ac4b8d2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.417782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.417733    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:05.557004 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.556974    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4qcmg"]
Jul 29 04:08:05.560266 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:05.560238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podeec03fcf_4b8a_40a4_914b_87247ac4b8d2.slice/crio-7aeb6d2027e2d8a5690b47da0bbf1d03c8a259642bf496c44e625f26683effbf WatchSource:0}: Error finding container 7aeb6d2027e2d8a5690b47da0bbf1d03c8a259642bf496c44e625f26683effbf: Status 404 returned error can't find the container with id 7aeb6d2027e2d8a5690b47da0bbf1d03c8a259642bf496c44e625f26683effbf
Jul 29 04:08:05.643993 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.643966    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"]
Jul 29 04:08:05.679711 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.679683    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"]
Jul 29 04:08:05.679843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.679806    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.682712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.682685    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 04:08:05.682712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.682684    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6ppf\""
Jul 29 04:08:05.682916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.682733    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 04:08:05.839369 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.839342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnk56\" (UniqueName: \"kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.839492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.839392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.839492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.839441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.940777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.940731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.940777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.940781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.940989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.940835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnk56\" (UniqueName: \"kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.941195 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.941172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.941285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.941182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.950304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.950279    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnk56\" (UniqueName: \"kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:05.988825 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:05.988793    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:06.131856 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:06.131835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"]
Jul 29 04:08:06.133422 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:06.133392    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod947ad210_e52f_4d22_8551_a01c1a8e29cd.slice/crio-2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd WatchSource:0}: Error finding container 2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd: Status 404 returned error can't find the container with id 2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd
Jul 29 04:08:06.480628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:06.480546    2578 generic.go:356] "Generic (PLEG): container finished" podID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerID="571d0d4fd0b3da680f000974b0a3a2d744f72726c0b6e62790a96381243cf60c" exitCode=0
Jul 29 04:08:06.480805 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:06.480618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt" event={"ID":"947ad210-e52f-4d22-8551-a01c1a8e29cd","Type":"ContainerDied","Data":"571d0d4fd0b3da680f000974b0a3a2d744f72726c0b6e62790a96381243cf60c"}
Jul 29 04:08:06.480805 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:06.480680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt" event={"ID":"947ad210-e52f-4d22-8551-a01c1a8e29cd","Type":"ContainerStarted","Data":"2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd"}
Jul 29 04:08:06.482070 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:06.482044    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg" event={"ID":"eec03fcf-4b8a-40a4-914b-87247ac4b8d2","Type":"ContainerStarted","Data":"7aeb6d2027e2d8a5690b47da0bbf1d03c8a259642bf496c44e625f26683effbf"}
Jul 29 04:08:07.026164 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:07.026133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:07.442330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:07.442213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:09.498640 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.498605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg" event={"ID":"eec03fcf-4b8a-40a4-914b-87247ac4b8d2","Type":"ContainerStarted","Data":"fa0152f233140c26a141dc4dcc210fec5e304ad18622563d779d89b5547034ad"}
Jul 29 04:08:09.499103 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.498740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:09.500345 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.500317    2578 generic.go:356] "Generic (PLEG): container finished" podID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerID="7a0f5ce3de2d5e0108f048de8d40a82f3a3a6c271a0ed530c685761506e8ab2d" exitCode=0
Jul 29 04:08:09.500449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.500377    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt" event={"ID":"947ad210-e52f-4d22-8551-a01c1a8e29cd","Type":"ContainerDied","Data":"7a0f5ce3de2d5e0108f048de8d40a82f3a3a6c271a0ed530c685761506e8ab2d"}
Jul 29 04:08:09.515217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.515176    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg" podStartSLOduration=1.110525602 podStartE2EDuration="4.515164324s" totalImagesPullingTime="3.404638722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:09.513908759 +0000 UTC m=+279.788925548" watchObservedRunningTime="2026-07-29 04:08:09.515164324 +0000 UTC m=+279.790181112"
Jul 29 04:08:09.818118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.818091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:09.918071 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:09.918027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:10.506020 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:10.505987    2578 generic.go:356] "Generic (PLEG): container finished" podID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerID="d01a989b9d3584a260b04885684510f97fc3e00273a13dabc79b016c79980132" exitCode=0
Jul 29 04:08:10.506391 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:10.506071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt" event={"ID":"947ad210-e52f-4d22-8551-a01c1a8e29cd","Type":"ContainerDied","Data":"d01a989b9d3584a260b04885684510f97fc3e00273a13dabc79b016c79980132"}
Jul 29 04:08:11.632688 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.632663    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:11.684250 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.684216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnk56\" (UniqueName: \"kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56\") pod \"947ad210-e52f-4d22-8551-a01c1a8e29cd\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") "
Jul 29 04:08:11.684392 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.684273    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle\") pod \"947ad210-e52f-4d22-8551-a01c1a8e29cd\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") "
Jul 29 04:08:11.684392 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.684327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util\") pod \"947ad210-e52f-4d22-8551-a01c1a8e29cd\" (UID: \"947ad210-e52f-4d22-8551-a01c1a8e29cd\") "
Jul 29 04:08:11.684655 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.684627    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle" (OuterVolumeSpecName: "bundle") pod "947ad210-e52f-4d22-8551-a01c1a8e29cd" (UID: "947ad210-e52f-4d22-8551-a01c1a8e29cd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:08:11.686283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.686262    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56" (OuterVolumeSpecName: "kube-api-access-pnk56") pod "947ad210-e52f-4d22-8551-a01c1a8e29cd" (UID: "947ad210-e52f-4d22-8551-a01c1a8e29cd"). InnerVolumeSpecName "kube-api-access-pnk56". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:08:11.688318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.688296    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util" (OuterVolumeSpecName: "util") pod "947ad210-e52f-4d22-8551-a01c1a8e29cd" (UID: "947ad210-e52f-4d22-8551-a01c1a8e29cd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:08:11.785594 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.785500    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:11.785594 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.785540    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/947ad210-e52f-4d22-8551-a01c1a8e29cd-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:11.785594 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:11.785549    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnk56\" (UniqueName: \"kubernetes.io/projected/947ad210-e52f-4d22-8551-a01c1a8e29cd-kube-api-access-pnk56\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:12.515992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:12.515960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt" event={"ID":"947ad210-e52f-4d22-8551-a01c1a8e29cd","Type":"ContainerDied","Data":"2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd"}
Jul 29 04:08:12.516146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:12.515998    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87flkjwt"
Jul 29 04:08:12.516146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:12.516009    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2c573a8d7aa2081c2aa076b8d5881061e4c852f41b355d674288a2e337d785bd"
Jul 29 04:08:14.227266 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:14.227232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:15.433438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:15.433407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:15.508514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:15.508486    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4qcmg"
Jul 29 04:08:15.530609 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:15.530584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:15.630727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:15.630700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:17.443667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"]
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443944    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="extract"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443956    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="extract"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443975    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="util"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443981    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="util"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443988    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="pull"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.443993    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="pull"
Jul 29 04:08:17.444069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.444040    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="947ad210-e52f-4d22-8551-a01c1a8e29cd" containerName="extract"
Jul 29 04:08:17.446041 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.446025    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.448542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.448511    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 29 04:08:17.448542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.448533    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-5v42h\""
Jul 29 04:08:17.449602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.449586    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 29 04:08:17.454301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.454281    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"]
Jul 29 04:08:17.521258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.521226    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlwpz\" (UniqueName: \"kubernetes.io/projected/3a78c8b9-dcb5-4c57-b981-e17d8c496393-kube-api-access-dlwpz\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.521411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.521265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a78c8b9-dcb5-4c57-b981-e17d8c496393-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.621614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.621586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlwpz\" (UniqueName: \"kubernetes.io/projected/3a78c8b9-dcb5-4c57-b981-e17d8c496393-kube-api-access-dlwpz\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.621822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.621623    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a78c8b9-dcb5-4c57-b981-e17d8c496393-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.621976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.621958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3a78c8b9-dcb5-4c57-b981-e17d8c496393-tmp\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.629671 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.629641    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlwpz\" (UniqueName: \"kubernetes.io/projected/3a78c8b9-dcb5-4c57-b981-e17d8c496393-kube-api-access-dlwpz\") pod \"openshift-lws-operator-fd8ccff4c-4ccxh\" (UID: \"3a78c8b9-dcb5-4c57-b981-e17d8c496393\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.755572 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.755495    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"
Jul 29 04:08:17.879437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:17.879336    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh"]
Jul 29 04:08:17.881568 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:17.881541    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3a78c8b9_dcb5_4c57_b981_e17d8c496393.slice/crio-aff8a076944a684cbd7c1726143681d7338ccffc1f5d96c8f79f0d4113bb42ac WatchSource:0}: Error finding container aff8a076944a684cbd7c1726143681d7338ccffc1f5d96c8f79f0d4113bb42ac: Status 404 returned error can't find the container with id aff8a076944a684cbd7c1726143681d7338ccffc1f5d96c8f79f0d4113bb42ac
Jul 29 04:08:18.542260 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:18.542224    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh" event={"ID":"3a78c8b9-dcb5-4c57-b981-e17d8c496393","Type":"ContainerStarted","Data":"aff8a076944a684cbd7c1726143681d7338ccffc1f5d96c8f79f0d4113bb42ac"}
Jul 29 04:08:20.554090 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:20.554055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh" event={"ID":"3a78c8b9-dcb5-4c57-b981-e17d8c496393","Type":"ContainerStarted","Data":"24ff5d38835e699a7adc6877f07542af99b0c66ca82739524b988a1a3f888810"}
Jul 29 04:08:20.571015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:20.570970    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-4ccxh" podStartSLOduration=1.852431858 podStartE2EDuration="3.57095334s" totalImagesPullingTime="1.718521482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:20.570481078 +0000 UTC m=+290.845497867" watchObservedRunningTime="2026-07-29 04:08:20.57095334 +0000 UTC m=+290.845970128"
Jul 29 04:08:21.263241 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:21.263207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:21.362894 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:21.362847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:23.118216 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.118188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:23.497956 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.497875    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"]
Jul 29 04:08:23.500193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.500176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.502838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.502816    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 29 04:08:23.502960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.502821    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 29 04:08:23.502960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.502851    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-x6ppf\""
Jul 29 04:08:23.508938 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.508916    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"]
Jul 29 04:08:23.571428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.571401    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgvt2\" (UniqueName: \"kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.571590 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.571476    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.571590 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.571503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.672213 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.672184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.672348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.672226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgvt2\" (UniqueName: \"kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.672348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.672285    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.672568 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.672548    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.672613 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.672594    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.681115 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.681090    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgvt2\" (UniqueName: \"kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.809866 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.809834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:23.931976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:23.931949    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"]
Jul 29 04:08:23.934089 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:23.934062    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f7a3389_4b09_4f3c_9f23_f5c3dd6386c9.slice/crio-597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010 WatchSource:0}: Error finding container 597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010: Status 404 returned error can't find the container with id 597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010
Jul 29 04:08:24.572476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:24.572444    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerID="46c5eac2a8e8807808378780fc6d17c15dbee54c61077f59008eb6074c37fcc4" exitCode=0
Jul 29 04:08:24.572925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:24.572512    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2" event={"ID":"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9","Type":"ContainerDied","Data":"46c5eac2a8e8807808378780fc6d17c15dbee54c61077f59008eb6074c37fcc4"}
Jul 29 04:08:24.572925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:24.572556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2" event={"ID":"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9","Type":"ContainerStarted","Data":"597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010"}
Jul 29 04:08:25.579171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:25.579143    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerID="6d0c1bd069f438698ea92f0cdb13f08bf82f8ec26279b280da953751d864e5ea" exitCode=0
Jul 29 04:08:25.579549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:25.579227    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2" event={"ID":"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9","Type":"ContainerDied","Data":"6d0c1bd069f438698ea92f0cdb13f08bf82f8ec26279b280da953751d864e5ea"}
Jul 29 04:08:26.584821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:26.584785    2578 generic.go:356] "Generic (PLEG): container finished" podID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerID="c0fc0a0244d5a07cb097d5128e315daf59332e2b9a1a158b1ad52f1abdf719b6" exitCode=0
Jul 29 04:08:26.585163 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:26.584872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2" event={"ID":"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9","Type":"ContainerDied","Data":"c0fc0a0244d5a07cb097d5128e315daf59332e2b9a1a158b1ad52f1abdf719b6"}
Jul 29 04:08:27.718475 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.718452    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:27.809769 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.809712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bgvt2\" (UniqueName: \"kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2\") pod \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") "
Jul 29 04:08:27.809932 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.809784    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util\") pod \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") "
Jul 29 04:08:27.809932 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.809813    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle\") pod \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\" (UID: \"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9\") "
Jul 29 04:08:27.810543 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.810519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle" (OuterVolumeSpecName: "bundle") pod "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" (UID: "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:08:27.811928 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.811906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2" (OuterVolumeSpecName: "kube-api-access-bgvt2") pod "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" (UID: "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9"). InnerVolumeSpecName "kube-api-access-bgvt2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:08:27.817816 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.817792    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util" (OuterVolumeSpecName: "util") pod "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" (UID: "5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:08:27.910806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.910698    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:27.910806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.910738    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:27.910806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:27.910763    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bgvt2\" (UniqueName: \"kubernetes.io/projected/5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9-kube-api-access-bgvt2\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:08:28.594642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:28.594618    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2"
Jul 29 04:08:28.594851 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:28.594612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afgcld2" event={"ID":"5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9","Type":"ContainerDied","Data":"597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010"}
Jul 29 04:08:28.594851 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:28.594738    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="597bb01df76e548a4b36253fe4dc76963d1d14d8e34a761cc9ff824cffff8010"
Jul 29 04:08:30.062991 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:30.062956    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:08:30.069634 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:30.069606    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:08:30.072970 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:30.072947    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 29 04:08:35.248190 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.248154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:35.359147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359112    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"]
Jul 29 04:08:35.359430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359419    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="pull"
Jul 29 04:08:35.359478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359432    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="pull"
Jul 29 04:08:35.359478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359455    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="util"
Jul 29 04:08:35.359478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359461    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="util"
Jul 29 04:08:35.359478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359471    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="extract"
Jul 29 04:08:35.359478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359477    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="extract"
Jul 29 04:08:35.359626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.359528    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5f7a3389-4b09-4f3c-9f23-f5c3dd6386c9" containerName="extract"
Jul 29 04:08:35.361276 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.361259    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.366159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.366126    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-tqhtl\""
Jul 29 04:08:35.366159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.366149    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 29 04:08:35.366159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.366157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 29 04:08:35.366435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.366130    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 29 04:08:35.377300 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.377272    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"]
Jul 29 04:08:35.471982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.471949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.471982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.471987    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-manager-config\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.472216 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.472019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncz7k\" (UniqueName: \"kubernetes.io/projected/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-kube-api-access-ncz7k\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.472216 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.472044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-metrics-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.573405 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.573370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.573405 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.573408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-manager-config\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.573640 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.573543    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncz7k\" (UniqueName: \"kubernetes.io/projected/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-kube-api-access-ncz7k\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.573640 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.573577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-metrics-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.574222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.574198    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-manager-config\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.575938 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.575919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.576068 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.576048    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-metrics-cert\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.581351 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.581332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncz7k\" (UniqueName: \"kubernetes.io/projected/9fde8888-2b9d-42ee-b60d-12a1f75a6d4b-kube-api-access-ncz7k\") pod \"lws-controller-manager-75c59548f9-gjjwj\" (UID: \"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b\") " pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.671150 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.671111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:35.809295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.809270    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"]
Jul 29 04:08:35.810858 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:35.810828    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fde8888_2b9d_42ee_b60d_12a1f75a6d4b.slice/crio-179a82b582938c31719987d9c616ab2e00d823302111b5f0abc7a5346e651816 WatchSource:0}: Error finding container 179a82b582938c31719987d9c616ab2e00d823302111b5f0abc7a5346e651816: Status 404 returned error can't find the container with id 179a82b582938c31719987d9c616ab2e00d823302111b5f0abc7a5346e651816
Jul 29 04:08:35.812625 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:35.812609    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:08:36.624515 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:36.624482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:36.632264 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:36.632226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj" event={"ID":"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b","Type":"ContainerStarted","Data":"179a82b582938c31719987d9c616ab2e00d823302111b5f0abc7a5346e651816"}
Jul 29 04:08:37.638343 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:37.638248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj" event={"ID":"9fde8888-2b9d-42ee-b60d-12a1f75a6d4b","Type":"ContainerStarted","Data":"42881a38d12cd30bab53f46bced4017df25d047487c15637c06e21bd385db526"}
Jul 29 04:08:37.638343 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:37.638310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:37.660650 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:37.660603    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj" podStartSLOduration=1.148724192 podStartE2EDuration="2.660588525s" totalImagesPullingTime="1.511864333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:37.659442326 +0000 UTC m=+307.934459150" watchObservedRunningTime="2026-07-29 04:08:37.660588525 +0000 UTC m=+307.935605312"
Jul 29 04:08:38.840583 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:38.840544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:38.934489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:38.934457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:39.488469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.488435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:39.817948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.817915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:39.909658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.909621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:39.940148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.940116    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"]
Jul 29 04:08:39.990625 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.990588    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"]
Jul 29 04:08:39.990808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.990708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:39.994107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.994086    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 29 04:08:39.995166 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.995142    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-6c7bk\""
Jul 29 04:08:39.995281 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.995142    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 29 04:08:39.995281 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.995184    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 29 04:08:39.995281 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:39.995156    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 29 04:08:40.109821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.109703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.109821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.109789    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46vt4\" (UniqueName: \"kubernetes.io/projected/937aba2e-d65b-4f31-bd6f-54df96944bd1-kube-api-access-46vt4\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.110024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.109838    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.110024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.109908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.110024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.109935    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.165424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.165389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.211214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.211380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46vt4\" (UniqueName: \"kubernetes.io/projected/937aba2e-d65b-4f31-bd6f-54df96944bd1-kube-api-access-46vt4\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.211380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.211380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211309    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.211380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211332    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.211692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.211660    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-manifests\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.213547 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.213526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/937aba2e-d65b-4f31-bd6f-54df96944bd1-tmp\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.213675 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.213657    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-webhook-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.213826 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.213809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/937aba2e-d65b-4f31-bd6f-54df96944bd1-apiservice-cert\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.220914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.220893    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46vt4\" (UniqueName: \"kubernetes.io/projected/937aba2e-d65b-4f31-bd6f-54df96944bd1-kube-api-access-46vt4\") pod \"opendatahub-operator-controller-manager-64c765c8-fsgkm\" (UID: \"937aba2e-d65b-4f31-bd6f-54df96944bd1\") " pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.269937 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.269903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.300997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.300964    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:40.366787 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.366705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.455399 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.455372    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"]
Jul 29 04:08:40.456935 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:08:40.456905    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod937aba2e_d65b_4f31_bd6f_54df96944bd1.slice/crio-4c4ce3c55bb37c167f7f169cd71426c9dbe9d0f95ab7b86e7611753e62c0cfd2 WatchSource:0}: Error finding container 4c4ce3c55bb37c167f7f169cd71426c9dbe9d0f95ab7b86e7611753e62c0cfd2: Status 404 returned error can't find the container with id 4c4ce3c55bb37c167f7f169cd71426c9dbe9d0f95ab7b86e7611753e62c0cfd2
Jul 29 04:08:40.459074 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.459042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.532161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.532132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.630439 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.630363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:40.652925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:40.652895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm" event={"ID":"937aba2e-d65b-4f31-bd6f-54df96944bd1","Type":"ContainerStarted","Data":"4c4ce3c55bb37c167f7f169cd71426c9dbe9d0f95ab7b86e7611753e62c0cfd2"}
Jul 29 04:08:43.670742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:43.670662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm" event={"ID":"937aba2e-d65b-4f31-bd6f-54df96944bd1","Type":"ContainerStarted","Data":"17410fd4e0a13e5b362d8604b0391bc96d12f700178aadd5cdeb01c7d903b7ed"}
Jul 29 04:08:44.677010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:44.676978    2578 generic.go:356] "Generic (PLEG): container finished" podID="937aba2e-d65b-4f31-bd6f-54df96944bd1" containerID="17410fd4e0a13e5b362d8604b0391bc96d12f700178aadd5cdeb01c7d903b7ed" exitCode=0
Jul 29 04:08:44.677318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:44.677029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm" event={"ID":"937aba2e-d65b-4f31-bd6f-54df96944bd1","Type":"ContainerDied","Data":"17410fd4e0a13e5b362d8604b0391bc96d12f700178aadd5cdeb01c7d903b7ed"}
Jul 29 04:08:45.682811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:45.682773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm" event={"ID":"937aba2e-d65b-4f31-bd6f-54df96944bd1","Type":"ContainerStarted","Data":"0b02b7dd5c7880a10ac8700b5a20d6bf8dcbf9457b7cc017c3b7f9ccf57118b4"}
Jul 29 04:08:45.683187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:45.682930    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:45.704419 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:45.704367    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm" podStartSLOduration=2.362138551 podStartE2EDuration="6.704352995s" totalImagesPullingTime="3.268843346s" totalInitContainerRuntime="1.073371098s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:08:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:08:45.70251555 +0000 UTC m=+315.977532367" watchObservedRunningTime="2026-07-29 04:08:45.704352995 +0000 UTC m=+315.979369806"
Jul 29 04:08:48.645077 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:48.645049    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-75c59548f9-gjjwj"
Jul 29 04:08:56.690325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:56.690293    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-64c765c8-fsgkm"
Jul 29 04:08:59.003642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.003606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:59.112638 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.112607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:59.404349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.404308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:59.647559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.647525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:59.873044 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.872998    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:08:59.960146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:08:59.960109    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:00.062561 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:00.062528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:00.193936 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:00.193855    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:00.790783 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:00.790734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:01.064608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:01.064526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:01.138561 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:01.138529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:01.206311 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:01.206276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:02.135247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:02.135188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:06.614017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.613981    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"]
Jul 29 04:09:06.618156 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.618140    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.622391 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.622369    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 29 04:09:06.622532 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.622418    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 29 04:09:06.622532 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.622433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 29 04:09:06.622682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.622667    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 29 04:09:06.623178 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.623153    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2qvd6\""
Jul 29 04:09:06.632945 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.632920    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"]
Jul 29 04:09:06.728504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728548    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ab3d0a-232f-45bb-93bb-cf20d244bf25-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2qxc\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-kube-api-access-q2qxc\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.728810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.728755    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.829888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.829858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.829888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.829891    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ab3d0a-232f-45bb-93bb-cf20d244bf25-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.829912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2qxc\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-kube-api-access-q2qxc\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.829964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.829981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.830001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.830020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.830692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.830665    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.832321 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.832300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.832430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.832345    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.832555 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.832530    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/43ab3d0a-232f-45bb-93bb-cf20d244bf25-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.832653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.832635    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/43ab3d0a-232f-45bb-93bb-cf20d244bf25-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.843415 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.843383    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2qxc\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-kube-api-access-q2qxc\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.844729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.844711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43ab3d0a-232f-45bb-93bb-cf20d244bf25-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-77l94\" (UID: \"43ab3d0a-232f-45bb-93bb-cf20d244bf25\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:06.916300 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.916245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:06.927577 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:06.927561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:07.011156 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:07.011128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:07.065448 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:07.065427    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"]
Jul 29 04:09:07.067395 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:09:07.067370    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43ab3d0a_232f_45bb_93bb_cf20d244bf25.slice/crio-3ec55ab45c3b5689fa83f2611bead1c063a81fe5ea668f03cb9a9a0cb8ca0dfe WatchSource:0}: Error finding container 3ec55ab45c3b5689fa83f2611bead1c063a81fe5ea668f03cb9a9a0cb8ca0dfe: Status 404 returned error can't find the container with id 3ec55ab45c3b5689fa83f2611bead1c063a81fe5ea668f03cb9a9a0cb8ca0dfe
Jul 29 04:09:07.729691 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:07.729651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:07.796375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:07.796299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94" event={"ID":"43ab3d0a-232f-45bb-93bb-cf20d244bf25","Type":"ContainerStarted","Data":"3ec55ab45c3b5689fa83f2611bead1c063a81fe5ea668f03cb9a9a0cb8ca0dfe"}
Jul 29 04:09:08.063637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:08.063605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:08.164309 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:08.164273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:09.372315 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.372272    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:09:09.372644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.372345    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:09:09.593444 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.593407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:09.705436 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.705353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:09.778434 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.778392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:09.809116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.809078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94" event={"ID":"43ab3d0a-232f-45bb-93bb-cf20d244bf25","Type":"ContainerStarted","Data":"afdd58db5aea2336b6896bd8bb85d4afa1a6ce90a8fc1c8190cf00867b4ddf1c"}
Jul 29 04:09:09.809282 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.809232    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:09.832441 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.832390    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94" podStartSLOduration=1.52969299 podStartE2EDuration="3.83237559s" totalImagesPullingTime="2.3026826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:09:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:09:09.830876715 +0000 UTC m=+340.105893503" watchObservedRunningTime="2026-07-29 04:09:09.83237559 +0000 UTC m=+340.107392378"
Jul 29 04:09:09.925788 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:09.925759    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:10.815496 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:10.815464    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-77l94"
Jul 29 04:09:10.958437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:10.958406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:11.041227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:11.041199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:09:11.101034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:09:11.100973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:00.438651 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:00.438560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:00.537242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:00.537204    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:00.611054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:00.611023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:01.368219 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:01.368185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:01.569768 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:01.569718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:15.975994 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.975953    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"]
Jul 29 04:10:15.979560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.979543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:15.981966 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.981940    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:10:15.982083 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.981968    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:10:15.982083 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.981969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g45cf\""
Jul 29 04:10:15.986738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:15.986426    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"]
Jul 29 04:10:16.076599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.076542    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.076813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.076630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.076813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.076657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrzqk\" (UniqueName: \"kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.178105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.178068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.178105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.178107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrzqk\" (UniqueName: \"kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.178315 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.178157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.178473 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.178452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.178547 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.178488    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.187235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.187211    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrzqk\" (UniqueName: \"kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.289777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.289729    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:16.417722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.417697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"]
Jul 29 04:10:16.419493 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:10:16.419461    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1309778_16a9_4f12_8ac6_5b1d0fa61239.slice/crio-06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871 WatchSource:0}: Error finding container 06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871: Status 404 returned error can't find the container with id 06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871
Jul 29 04:10:16.579283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.579220    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"]
Jul 29 04:10:16.583478 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.583456    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.593501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.593459    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"]
Jul 29 04:10:16.683581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.683554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7n9n\" (UniqueName: \"kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.683742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.683616    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.683742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.683663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.784013 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.783985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7n9n\" (UniqueName: \"kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.784136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.784043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.784136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.784066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.784372 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.784357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.784434 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.784416    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.791725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.791704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7n9n\" (UniqueName: \"kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:16.902295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:16.902243    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:17.028265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.028234    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"]
Jul 29 04:10:17.031039 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:10:17.031012    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod721b1c05_44cc_4f36_9df3_5012995cb1ce.slice/crio-0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20 WatchSource:0}: Error finding container 0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20: Status 404 returned error can't find the container with id 0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20
Jul 29 04:10:17.116829 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.116795    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerID="00aaf7ee7b7344209a0a4d60cc87e5c72de5f9b4676065df6362c912e5e6a373" exitCode=0
Jul 29 04:10:17.116985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.116886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f" event={"ID":"c1309778-16a9-4f12-8ac6-5b1d0fa61239","Type":"ContainerDied","Data":"00aaf7ee7b7344209a0a4d60cc87e5c72de5f9b4676065df6362c912e5e6a373"}
Jul 29 04:10:17.116985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.116948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f" event={"ID":"c1309778-16a9-4f12-8ac6-5b1d0fa61239","Type":"ContainerStarted","Data":"06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871"}
Jul 29 04:10:17.118514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.118493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerStarted","Data":"2dfbc89a59eba34d33afce721060021202f4f622f9a01ef82cff21fd9232ab09"}
Jul 29 04:10:17.118620 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.118530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerStarted","Data":"0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20"}
Jul 29 04:10:17.177211 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.177155    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"]
Jul 29 04:10:17.180841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.180826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.189409 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.189388    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"]
Jul 29 04:10:17.288049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.288018    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86rk4\" (UniqueName: \"kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.288190 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.288086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.288256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.288227    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.388883 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.388855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86rk4\" (UniqueName: \"kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.389024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.388907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.389024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.388946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.389316 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.389298    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.389356 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.389315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.398476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.398453    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-86rk4\" (UniqueName: \"kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.508876 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.508814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:17.658874 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.658838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"]
Jul 29 04:10:17.678023 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:10:17.677986    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8886bc10_9e68_48ae_87e2_9a9bd15f2110.slice/crio-48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0 WatchSource:0}: Error finding container 48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0: Status 404 returned error can't find the container with id 48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0
Jul 29 04:10:17.777121 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.777090    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"]
Jul 29 04:10:17.780672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.780649    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.790583 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.790558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"]
Jul 29 04:10:17.893584 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.893561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.893678 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.893592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.893678 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.893634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tggg\" (UniqueName: \"kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.994695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.994667    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tggg\" (UniqueName: \"kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.994809 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.994777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.994809 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.994801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.995113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.995096    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:17.995113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:17.995106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:18.002393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.002368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tggg\" (UniqueName: \"kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:18.118830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.118772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:18.125545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.125521    2578 generic.go:356] "Generic (PLEG): container finished" podID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerID="2dfbc89a59eba34d33afce721060021202f4f622f9a01ef82cff21fd9232ab09" exitCode=0
Jul 29 04:10:18.125645 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.125611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerDied","Data":"2dfbc89a59eba34d33afce721060021202f4f622f9a01ef82cff21fd9232ab09"}
Jul 29 04:10:18.127466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.127442    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerID="8ff7cc028d86783a0049a0ec856a3400f8a24cc883327015b3c60d58273b4fe4" exitCode=0
Jul 29 04:10:18.127564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.127534    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f" event={"ID":"c1309778-16a9-4f12-8ac6-5b1d0fa61239","Type":"ContainerDied","Data":"8ff7cc028d86783a0049a0ec856a3400f8a24cc883327015b3c60d58273b4fe4"}
Jul 29 04:10:18.129245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.129223    2578 generic.go:356] "Generic (PLEG): container finished" podID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerID="5f02de116d16bdc0695bd08676644748e8a64f8961d658e8198095828f8b65b7" exitCode=0
Jul 29 04:10:18.129348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.129322    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7" event={"ID":"8886bc10-9e68-48ae-87e2-9a9bd15f2110","Type":"ContainerDied","Data":"5f02de116d16bdc0695bd08676644748e8a64f8961d658e8198095828f8b65b7"}
Jul 29 04:10:18.129402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.129366    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7" event={"ID":"8886bc10-9e68-48ae-87e2-9a9bd15f2110","Type":"ContainerStarted","Data":"48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0"}
Jul 29 04:10:18.261400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:18.261369    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"]
Jul 29 04:10:18.263468 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:10:18.263437    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2bb03f_a4a2_485d_8049_084986ee7dd8.slice/crio-a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61 WatchSource:0}: Error finding container a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61: Status 404 returned error can't find the container with id a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61
Jul 29 04:10:19.136131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.136102    2578 generic.go:356] "Generic (PLEG): container finished" podID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerID="cc9b543d16731407b86438fafdf72adc85ba3188df2d5c63c2aa460b065500af" exitCode=0
Jul 29 04:10:19.136442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.136180    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7" event={"ID":"8886bc10-9e68-48ae-87e2-9a9bd15f2110","Type":"ContainerDied","Data":"cc9b543d16731407b86438fafdf72adc85ba3188df2d5c63c2aa460b065500af"}
Jul 29 04:10:19.137602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.137586    2578 generic.go:356] "Generic (PLEG): container finished" podID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerID="a0190fb62d305f80efcb67ca276cbb3b2fd09aa05b6507f3f5fe9e8d8b45bc1a" exitCode=0
Jul 29 04:10:19.137702 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.137676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69" event={"ID":"3c2bb03f-a4a2-485d-8049-084986ee7dd8","Type":"ContainerDied","Data":"a0190fb62d305f80efcb67ca276cbb3b2fd09aa05b6507f3f5fe9e8d8b45bc1a"}
Jul 29 04:10:19.137767 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.137732    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69" event={"ID":"3c2bb03f-a4a2-485d-8049-084986ee7dd8","Type":"ContainerStarted","Data":"a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61"}
Jul 29 04:10:19.146001 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.145972    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerID="d2236d7540423666a0c95afe755aeb2b1f0a7fe29713417a80a4dd4ce0956ff6" exitCode=0
Jul 29 04:10:19.146096 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:19.146014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f" event={"ID":"c1309778-16a9-4f12-8ac6-5b1d0fa61239","Type":"ContainerDied","Data":"d2236d7540423666a0c95afe755aeb2b1f0a7fe29713417a80a4dd4ce0956ff6"}
Jul 29 04:10:20.153096 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.153013    2578 generic.go:356] "Generic (PLEG): container finished" podID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerID="61df221d3ce43dbb1f099de7e7ed14ba392e6329d65baa5a55fe8c4b84ab4979" exitCode=0
Jul 29 04:10:20.153503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.153105    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7" event={"ID":"8886bc10-9e68-48ae-87e2-9a9bd15f2110","Type":"ContainerDied","Data":"61df221d3ce43dbb1f099de7e7ed14ba392e6329d65baa5a55fe8c4b84ab4979"}
Jul 29 04:10:20.154810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.154785    2578 generic.go:356] "Generic (PLEG): container finished" podID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerID="e3c7376816cc47906fdaea9eca98d6c3abc17eda59a2b64864722f43a784b402" exitCode=0
Jul 29 04:10:20.154921 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.154866    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69" event={"ID":"3c2bb03f-a4a2-485d-8049-084986ee7dd8","Type":"ContainerDied","Data":"e3c7376816cc47906fdaea9eca98d6c3abc17eda59a2b64864722f43a784b402"}
Jul 29 04:10:20.156782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.156736    2578 generic.go:356] "Generic (PLEG): container finished" podID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerID="fcc5e426c5c647477009f5bdf81bc4c1c4987744050514f01d5bb1bd8ee1824c" exitCode=0
Jul 29 04:10:20.156881 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.156777    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerDied","Data":"fcc5e426c5c647477009f5bdf81bc4c1c4987744050514f01d5bb1bd8ee1824c"}
Jul 29 04:10:20.312259 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.312231    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:20.416453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.416381    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vrzqk\" (UniqueName: \"kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk\") pod \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") "
Jul 29 04:10:20.416593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.416489    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util\") pod \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") "
Jul 29 04:10:20.416593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.416531    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle\") pod \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\" (UID: \"c1309778-16a9-4f12-8ac6-5b1d0fa61239\") "
Jul 29 04:10:20.417031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.417002    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle" (OuterVolumeSpecName: "bundle") pod "c1309778-16a9-4f12-8ac6-5b1d0fa61239" (UID: "c1309778-16a9-4f12-8ac6-5b1d0fa61239"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:20.418581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.418550    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk" (OuterVolumeSpecName: "kube-api-access-vrzqk") pod "c1309778-16a9-4f12-8ac6-5b1d0fa61239" (UID: "c1309778-16a9-4f12-8ac6-5b1d0fa61239"). InnerVolumeSpecName "kube-api-access-vrzqk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:10:20.421510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.421492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util" (OuterVolumeSpecName: "util") pod "c1309778-16a9-4f12-8ac6-5b1d0fa61239" (UID: "c1309778-16a9-4f12-8ac6-5b1d0fa61239"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:20.517827 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.517799    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:20.517827 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.517824    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vrzqk\" (UniqueName: \"kubernetes.io/projected/c1309778-16a9-4f12-8ac6-5b1d0fa61239-kube-api-access-vrzqk\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:20.517983 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:20.517834    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1309778-16a9-4f12-8ac6-5b1d0fa61239-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:21.163428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.163388    2578 generic.go:356] "Generic (PLEG): container finished" podID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerID="254abc6511fc23e2a9c62b7e2f3a4cd62432e9f78be14fb6eb4f8a0ea0770e1b" exitCode=0
Jul 29 04:10:21.163879 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.163477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69" event={"ID":"3c2bb03f-a4a2-485d-8049-084986ee7dd8","Type":"ContainerDied","Data":"254abc6511fc23e2a9c62b7e2f3a4cd62432e9f78be14fb6eb4f8a0ea0770e1b"}
Jul 29 04:10:21.165412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.165391    2578 generic.go:356] "Generic (PLEG): container finished" podID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerID="4ed7ff124716a3328f45471952d53a0dc48a0dd311bb5fc61bd19b9448eb7ce6" exitCode=0
Jul 29 04:10:21.165541 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.165473    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerDied","Data":"4ed7ff124716a3328f45471952d53a0dc48a0dd311bb5fc61bd19b9448eb7ce6"}
Jul 29 04:10:21.167208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.167185    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f"
Jul 29 04:10:21.167322 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.167212    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f" event={"ID":"c1309778-16a9-4f12-8ac6-5b1d0fa61239","Type":"ContainerDied","Data":"06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871"}
Jul 29 04:10:21.167322 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.167254    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="06b506afc87e6616e64507a94a2fa0c5367269e47798ae22a0534fa66e498871"
Jul 29 04:10:21.299617 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.299594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:21.425624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.425545    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle\") pod \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") "
Jul 29 04:10:21.425624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.425578    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86rk4\" (UniqueName: \"kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4\") pod \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") "
Jul 29 04:10:21.425624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.425622    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util\") pod \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\" (UID: \"8886bc10-9e68-48ae-87e2-9a9bd15f2110\") "
Jul 29 04:10:21.426337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.426293    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle" (OuterVolumeSpecName: "bundle") pod "8886bc10-9e68-48ae-87e2-9a9bd15f2110" (UID: "8886bc10-9e68-48ae-87e2-9a9bd15f2110"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:21.427644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.427617    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4" (OuterVolumeSpecName: "kube-api-access-86rk4") pod "8886bc10-9e68-48ae-87e2-9a9bd15f2110" (UID: "8886bc10-9e68-48ae-87e2-9a9bd15f2110"). InnerVolumeSpecName "kube-api-access-86rk4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:10:21.431421 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.431400    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util" (OuterVolumeSpecName: "util") pod "8886bc10-9e68-48ae-87e2-9a9bd15f2110" (UID: "8886bc10-9e68-48ae-87e2-9a9bd15f2110"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:21.526429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.526403    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:21.526429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.526424    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86rk4\" (UniqueName: \"kubernetes.io/projected/8886bc10-9e68-48ae-87e2-9a9bd15f2110-kube-api-access-86rk4\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:21.526627 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:21.526433    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8886bc10-9e68-48ae-87e2-9a9bd15f2110-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.174327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.174275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7" event={"ID":"8886bc10-9e68-48ae-87e2-9a9bd15f2110","Type":"ContainerDied","Data":"48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0"}
Jul 29 04:10:22.174327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.174312    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7"
Jul 29 04:10:22.174888 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.174369    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="48091958a1ecbd8ac72ff2fe09d304e9d7184b2c4ab5e27da0748440fa8108c0"
Jul 29 04:10:22.310901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.310876    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:22.344099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.344073    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:22.437730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.437643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle\") pod \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") "
Jul 29 04:10:22.437730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.437703    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tggg\" (UniqueName: \"kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg\") pod \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") "
Jul 29 04:10:22.438236 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.437770    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util\") pod \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\" (UID: \"3c2bb03f-a4a2-485d-8049-084986ee7dd8\") "
Jul 29 04:10:22.438236 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.438194    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle" (OuterVolumeSpecName: "bundle") pod "3c2bb03f-a4a2-485d-8049-084986ee7dd8" (UID: "3c2bb03f-a4a2-485d-8049-084986ee7dd8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:22.439847 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.439822    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg" (OuterVolumeSpecName: "kube-api-access-2tggg") pod "3c2bb03f-a4a2-485d-8049-084986ee7dd8" (UID: "3c2bb03f-a4a2-485d-8049-084986ee7dd8"). InnerVolumeSpecName "kube-api-access-2tggg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:10:22.445503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.445479    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util" (OuterVolumeSpecName: "util") pod "3c2bb03f-a4a2-485d-8049-084986ee7dd8" (UID: "3c2bb03f-a4a2-485d-8049-084986ee7dd8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:22.538402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7n9n\" (UniqueName: \"kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n\") pod \"721b1c05-44cc-4f36-9df3-5012995cb1ce\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") "
Jul 29 04:10:22.538556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538486    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util\") pod \"721b1c05-44cc-4f36-9df3-5012995cb1ce\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") "
Jul 29 04:10:22.538556 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle\") pod \"721b1c05-44cc-4f36-9df3-5012995cb1ce\" (UID: \"721b1c05-44cc-4f36-9df3-5012995cb1ce\") "
Jul 29 04:10:22.538770 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538726    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.538836 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538772    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tggg\" (UniqueName: \"kubernetes.io/projected/3c2bb03f-a4a2-485d-8049-084986ee7dd8-kube-api-access-2tggg\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.538836 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538787    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c2bb03f-a4a2-485d-8049-084986ee7dd8-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.539019 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.538993    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle" (OuterVolumeSpecName: "bundle") pod "721b1c05-44cc-4f36-9df3-5012995cb1ce" (UID: "721b1c05-44cc-4f36-9df3-5012995cb1ce"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:22.540451 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.540427    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n" (OuterVolumeSpecName: "kube-api-access-k7n9n") pod "721b1c05-44cc-4f36-9df3-5012995cb1ce" (UID: "721b1c05-44cc-4f36-9df3-5012995cb1ce"). InnerVolumeSpecName "kube-api-access-k7n9n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:10:22.570384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.570356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util" (OuterVolumeSpecName: "util") pod "721b1c05-44cc-4f36-9df3-5012995cb1ce" (UID: "721b1c05-44cc-4f36-9df3-5012995cb1ce"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:10:22.639362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.639335    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-util\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.639362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.639358    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/721b1c05-44cc-4f36-9df3-5012995cb1ce-bundle\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:22.639362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:22.639367    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7n9n\" (UniqueName: \"kubernetes.io/projected/721b1c05-44cc-4f36-9df3-5012995cb1ce-kube-api-access-k7n9n\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:10:23.180901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.180873    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69"
Jul 29 04:10:23.181397 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.180869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69" event={"ID":"3c2bb03f-a4a2-485d-8049-084986ee7dd8","Type":"ContainerDied","Data":"a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61"}
Jul 29 04:10:23.181397 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.181010    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a964b4053dee6f7028e376b0681281202002f431445112c56ea69050ec47ac61"
Jul 29 04:10:23.182674 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.182649    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669"
Jul 29 04:10:23.182674 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.182650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669" event={"ID":"721b1c05-44cc-4f36-9df3-5012995cb1ce","Type":"ContainerDied","Data":"0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20"}
Jul 29 04:10:23.182849 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:23.182693    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0fca647fb0245c3fe1a80111a2592ddd22ed51a5f186aeb1c4d10e7f7a8a4b20"
Jul 29 04:10:29.772476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:29.772432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:33.967076 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:33.967039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:35.783004 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:35.782965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:35.859050 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:35.859018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:36.379568 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:36.379533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:36.619573 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:36.619538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:36.968212 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:36.968183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:37.842230 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:37.842195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:37.939544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:37.939510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:40.372111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:40.372075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:41.411986 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:41.411954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:43.410642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:43.410609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:45.203357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:45.203296    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:46.633075 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:46.633022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:46.746187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:46.746155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:50.364999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:50.364962    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:50.466581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:50.466540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:52.874932 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:52.874842    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:52.934669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:52.934628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:54.579105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:54.579073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:54.682668 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:54.682634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:55.068159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:55.068125    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:10:55.167944 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:10:55.167909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:00.568629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:00.568573    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:00.625633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:00.625598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:08.170219 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:08.170181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:08.270337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:08.270304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:11.178581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:11.178548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:11.276157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:11.276124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:15.976616 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:15.976581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:16.075258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:16.075232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:18.496409 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496378    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496831    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="pull"
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496849    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="pull"
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496865    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="util"
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496872    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="util"
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496880    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="extract"
Jul 29 04:11:18.496886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496888    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496903    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496911    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496925    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496932    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496947    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496954    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496971    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496979    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496988    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.496996    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497008    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497015    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497031    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497038    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="util"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497048    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497056    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="pull"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497065    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497073    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497167    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1309778-16a9-4f12-8ac6-5b1d0fa61239" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497179    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8886bc10-9e68-48ae-87e2-9a9bd15f2110" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497189    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="721b1c05-44cc-4f36-9df3-5012995cb1ce" containerName="extract"
Jul 29 04:11:18.497290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.497198    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c2bb03f-a4a2-485d-8049-084986ee7dd8" containerName="extract"
Jul 29 04:11:18.500301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.500281    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.503258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.503225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:11:18.503383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.503242    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:11:18.503383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.503347    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-nkp54\""
Jul 29 04:11:18.513548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.513530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:11:18.593217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.593194    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.593318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.593230    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w62n6\" (UniqueName: \"kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.694107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.694074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.694221 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.694129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w62n6\" (UniqueName: \"kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.694511 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.694494    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.704673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.704645    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w62n6\" (UniqueName: \"kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6\") pod \"kuadrant-operator-controller-manager-86878c769f-n6jds\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.809768 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.809719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:18.939450 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:18.939428    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:11:18.941639 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:11:18.941614    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda48fb4d2_27a4_4b7d_861c_511a7d360896.slice/crio-ac40cb7b2203ad6da39b49f30507281804d693b2c418144cfb94c5a08206cf58 WatchSource:0}: Error finding container ac40cb7b2203ad6da39b49f30507281804d693b2c418144cfb94c5a08206cf58: Status 404 returned error can't find the container with id ac40cb7b2203ad6da39b49f30507281804d693b2c418144cfb94c5a08206cf58
Jul 29 04:11:19.468205 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:19.468162    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" event={"ID":"a48fb4d2-27a4-4b7d-861c-511a7d360896","Type":"ContainerStarted","Data":"ac40cb7b2203ad6da39b49f30507281804d693b2c418144cfb94c5a08206cf58"}
Jul 29 04:11:19.545904 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:19.545874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:19.643192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:19.643148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:24.497671 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:24.497624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" event={"ID":"a48fb4d2-27a4-4b7d-861c-511a7d360896","Type":"ContainerStarted","Data":"0913695536f64c9281c28df375dae6f0d385eaa574e0170605bf125f017466bd"}
Jul 29 04:11:24.498141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:24.497825    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:24.519383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:24.519334    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" podStartSLOduration=1.476337613 podStartE2EDuration="6.519318826s" totalImagesPullingTime="5.042981213s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:11:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:11:24.517288253 +0000 UTC m=+474.792305040" watchObservedRunningTime="2026-07-29 04:11:24.519318826 +0000 UTC m=+474.794335649"
Jul 29 04:11:26.155283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:26.155245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:26.255648 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:26.255613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:29.350317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:29.350281    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:29.450538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:29.450506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:31.680974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:31.680933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:31.782254 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:31.782212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:33.952208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:33.952177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:34.052525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:34.052481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:34.152477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:34.152448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:34.253009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:34.252914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:34.564637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:34.564606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:35.195695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:35.195666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:35.504924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:35.504829    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:11:38.950848 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:38.950811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:39.009561 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:39.009530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:50.475987 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:50.475955    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:50.581690 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:50.581660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:50.684269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:50.684237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:51.290131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:51.290095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:11:51.390390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:11:51.390358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:08.015352 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:08.015314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:08.117212 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:08.117170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:08.218642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:08.218617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:08.462411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:08.462340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:11.772050 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:11.772017    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:11.825599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:11.825566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:21.132196 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:21.132148    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:21.385020 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:21.384924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:27.398339 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:27.398305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:27.495688 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:27.495657    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:27.564917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:27.564881    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:27.738515 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:27.738425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:31.003318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:31.003287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:12:31.099532 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:12:31.099484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:03.244348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:03.244311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:03.344452 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:03.344425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:03.898338 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:03.898305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:04.366857 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.366810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:04.469356 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.469321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:04.484948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.484911    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"]
Jul 29 04:13:04.488698 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.488677    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.491512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.491472    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 29 04:13:04.491821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.491803    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-p4gdw\""
Jul 29 04:13:04.502277 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.502254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"]
Jul 29 04:13:04.622624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.622546    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca0fb86-f420-491c-b4d3-d8d7f706f896-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.622624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.622591    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvr86\" (UniqueName: \"kubernetes.io/projected/8ca0fb86-f420-491c-b4d3-d8d7f706f896-kube-api-access-qvr86\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.723170 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.723138    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca0fb86-f420-491c-b4d3-d8d7f706f896-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.723340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.723178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvr86\" (UniqueName: \"kubernetes.io/projected/8ca0fb86-f420-491c-b4d3-d8d7f706f896-kube-api-access-qvr86\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.723926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.723904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ca0fb86-f420-491c-b4d3-d8d7f706f896-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.737723 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.737700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvr86\" (UniqueName: \"kubernetes.io/projected/8ca0fb86-f420-491c-b4d3-d8d7f706f896-kube-api-access-qvr86\") pod \"payload-pre-processing-687dbb6cf6-bdfv5\" (UID: \"8ca0fb86-f420-491c-b4d3-d8d7f706f896\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.799569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.799547    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:04.931417 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.931392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"]
Jul 29 04:13:04.932994 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:13:04.932962    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ca0fb86_f420_491c_b4d3_d8d7f706f896.slice/crio-73831069fb2f245afaba4eedab7c5b634956bccd509034513f310992bbecf64f WatchSource:0}: Error finding container 73831069fb2f245afaba4eedab7c5b634956bccd509034513f310992bbecf64f: Status 404 returned error can't find the container with id 73831069fb2f245afaba4eedab7c5b634956bccd509034513f310992bbecf64f
Jul 29 04:13:04.994073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:04.994049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5" event={"ID":"8ca0fb86-f420-491c-b4d3-d8d7f706f896","Type":"ContainerStarted","Data":"73831069fb2f245afaba4eedab7c5b634956bccd509034513f310992bbecf64f"}
Jul 29 04:13:07.006672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:07.006633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5" event={"ID":"8ca0fb86-f420-491c-b4d3-d8d7f706f896","Type":"ContainerStarted","Data":"e3ad74f160a8ac6aedaf3a50feb07b079f653cd2cf33a3bc875980a1010202cd"}
Jul 29 04:13:07.007149 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:07.006699    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:16.092438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:16.092400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:16.191351 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:16.191315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:18.016808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:18.016778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5"
Jul 29 04:13:18.032370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:18.032319    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-bdfv5" podStartSLOduration=12.486161597 podStartE2EDuration="14.032304313s" totalImagesPullingTime="1.546142716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:13:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:13:07.023952096 +0000 UTC m=+577.298968886" watchObservedRunningTime="2026-07-29 04:13:18.032304313 +0000 UTC m=+588.307321100"
Jul 29 04:13:20.128835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.128802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"]
Jul 29 04:13:20.132760 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.132728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.136430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.136407    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 29 04:13:20.136549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.136458    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 29 04:13:20.136693 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.136670    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hrx5q\""
Jul 29 04:13:20.136838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.136740    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 29 04:13:20.140054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.140028    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"]
Jul 29 04:13:20.153404 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.153384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:20.242222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.242357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242235    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefe3072-0205-4cb4-a406-bbf5242da49b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.242357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242331    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.242457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.242457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242415    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hrzb\" (UniqueName: \"kubernetes.io/projected/aefe3072-0205-4cb4-a406-bbf5242da49b-kube-api-access-5hrzb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.242548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.242459    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343129 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefe3072-0205-4cb4-a406-bbf5242da49b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343400    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hrzb\" (UniqueName: \"kubernetes.io/projected/aefe3072-0205-4cb4-a406-bbf5242da49b-kube-api-access-5hrzb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343471    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343560    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.343853 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.343827    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.345457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.345430    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/aefe3072-0205-4cb4-a406-bbf5242da49b-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.345816 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.345798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/aefe3072-0205-4cb4-a406-bbf5242da49b-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.350759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.350726    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hrzb\" (UniqueName: \"kubernetes.io/projected/aefe3072-0205-4cb4-a406-bbf5242da49b-kube-api-access-5hrzb\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb\" (UID: \"aefe3072-0205-4cb4-a406-bbf5242da49b\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.444497 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.444424    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:20.578560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:20.578534    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"]
Jul 29 04:13:20.579902 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:13:20.579878    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaefe3072_0205_4cb4_a406_bbf5242da49b.slice/crio-d864da9cc9b7ad73df276f9e0a77a0ba76e5d3ccb29d10463d89af91d2d6249a WatchSource:0}: Error finding container d864da9cc9b7ad73df276f9e0a77a0ba76e5d3ccb29d10463d89af91d2d6249a: Status 404 returned error can't find the container with id d864da9cc9b7ad73df276f9e0a77a0ba76e5d3ccb29d10463d89af91d2d6249a
Jul 29 04:13:21.083760 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:21.083711    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb" event={"ID":"aefe3072-0205-4cb4-a406-bbf5242da49b","Type":"ContainerStarted","Data":"d864da9cc9b7ad73df276f9e0a77a0ba76e5d3ccb29d10463d89af91d2d6249a"}
Jul 29 04:13:22.090297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:22.090255    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb" event={"ID":"aefe3072-0205-4cb4-a406-bbf5242da49b","Type":"ContainerStarted","Data":"79c49c28543b6ef42405f66d29864ab785a3981128507a342b120f3969838e9a"}
Jul 29 04:13:22.108681 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:22.108634    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb" podStartSLOduration=1.028348847 podStartE2EDuration="2.108618653s" totalImagesPullingTime="1.080269806s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:13:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:13:22.106010639 +0000 UTC m=+592.381027426" watchObservedRunningTime="2026-07-29 04:13:22.108618653 +0000 UTC m=+592.383635441"
Jul 29 04:13:25.010429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:25.010392    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:30.098794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:30.098767    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:13:30.100436 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:30.100415    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:13:30.445447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:30.445367    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:30.445447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:30.445425    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:30.457512 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:30.457489    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:31.145440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:31.145411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb"
Jul 29 04:13:31.653923 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:31.653893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:41.142917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:41.142879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:46.657084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:46.657049    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:51.523198 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.523160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"]
Jul 29 04:13:51.525540 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.525523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.528200 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.528168    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 29 04:13:51.540683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.540655    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"]
Jul 29 04:13:51.569368 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.569338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:13:51.683571 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.683699 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683585    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bvpw\" (UniqueName: \"kubernetes.io/projected/b9c4c317-6974-476c-8a01-3a2e3fb4319d-kube-api-access-6bvpw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.683699 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.683699 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.683699 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.683861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.683701    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784439 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784439 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bvpw\" (UniqueName: \"kubernetes.io/projected/b9c4c317-6974-476c-8a01-3a2e3fb4319d-kube-api-access-6bvpw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784582 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784582 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784582 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784582 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784973 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.784973 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.784922    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.786720 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.786698    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b9c4c317-6974-476c-8a01-3a2e3fb4319d-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.787009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.786991    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b9c4c317-6974-476c-8a01-3a2e3fb4319d-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.791786 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.791765    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bvpw\" (UniqueName: \"kubernetes.io/projected/b9c4c317-6974-476c-8a01-3a2e3fb4319d-kube-api-access-6bvpw\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-pf4lk\" (UID: \"b9c4c317-6974-476c-8a01-3a2e3fb4319d\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.838233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.838208    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:13:51.970986 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.970962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"]
Jul 29 04:13:51.972403 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:13:51.972374    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9c4c317_6974_476c_8a01_3a2e3fb4319d.slice/crio-c3504f24fd9fb4d9cc0edbc7a0fd1c9a3ec0a14bc26c7a963162450fbe209836 WatchSource:0}: Error finding container c3504f24fd9fb4d9cc0edbc7a0fd1c9a3ec0a14bc26c7a963162450fbe209836: Status 404 returned error can't find the container with id c3504f24fd9fb4d9cc0edbc7a0fd1c9a3ec0a14bc26c7a963162450fbe209836
Jul 29 04:13:51.973737 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:51.973721    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:13:52.249672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:52.249597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk" event={"ID":"b9c4c317-6974-476c-8a01-3a2e3fb4319d","Type":"ContainerStarted","Data":"cc0f9099c4143726d182435eaee835e87abb3208c9df4fe1f2f5ac3d9afeb025"}
Jul 29 04:13:52.249864 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:52.249688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk" event={"ID":"b9c4c317-6974-476c-8a01-3a2e3fb4319d","Type":"ContainerStarted","Data":"c3504f24fd9fb4d9cc0edbc7a0fd1c9a3ec0a14bc26c7a963162450fbe209836"}
Jul 29 04:13:52.267214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:52.267168    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk" podStartSLOduration=1.102515758 podStartE2EDuration="1.267152717s" totalImagesPullingTime="164.636959ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:13:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:13:52.264793671 +0000 UTC m=+622.539810460" watchObservedRunningTime="2026-07-29 04:13:52.267152717 +0000 UTC m=+622.542169503"
Jul 29 04:13:52.852459 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:13:52.852375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:01.838339 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:01.838309    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:14:01.838821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:01.838543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:14:01.850560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:01.850540    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:14:02.314350 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:02.314323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-pf4lk"
Jul 29 04:14:03.207921 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:03.207888    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:05.200141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:05.200102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:09.534408 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:09.534374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:57.139248 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:57.139211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:57.242801 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:57.242769    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:58.352529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:58.352488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:14:58.462334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:14:58.462305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:15:13.177673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:15:13.177631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:17:03.662518 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:17:03.662444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:17:04.860586 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:17:04.860540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:12.069805 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:12.069736    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:12.248428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:12.248394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:12.402856 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:12.402775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:18.351497 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:18.351454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:18.454499 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:18.454449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:18.551653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:18.551621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:18.706945 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:18.706828    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:24.743161 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:24.743072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:24.843319 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:24.843290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:18:30.135109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:30.135080    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:18:30.135575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:18:30.135404    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:20:11.609447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:20:11.609366    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:20:13.060097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:20:13.060059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:20:16.292021 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:20:16.291983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:23:07.263157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:07.263080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:23:25.980946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:25.980907    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:23:25.981463 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:25.981114    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" podUID="a48fb4d2-27a4-4b7d-861c-511a7d360896" containerName="manager" containerID="cri-o://0913695536f64c9281c28df375dae6f0d385eaa574e0170605bf125f017466bd" gracePeriod=10
Jul 29 04:23:28.190335 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.190293    2578 generic.go:356] "Generic (PLEG): container finished" podID="a48fb4d2-27a4-4b7d-861c-511a7d360896" containerID="0913695536f64c9281c28df375dae6f0d385eaa574e0170605bf125f017466bd" exitCode=0
Jul 29 04:23:28.195421 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.195344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" event={"ID":"a48fb4d2-27a4-4b7d-861c-511a7d360896","Type":"ContainerDied","Data":"0913695536f64c9281c28df375dae6f0d385eaa574e0170605bf125f017466bd"}
Jul 29 04:23:28.337394 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.337364    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:23:28.406346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.406319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume\") pod \"a48fb4d2-27a4-4b7d-861c-511a7d360896\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") "
Jul 29 04:23:28.406475 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.406352    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w62n6\" (UniqueName: \"kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6\") pod \"a48fb4d2-27a4-4b7d-861c-511a7d360896\" (UID: \"a48fb4d2-27a4-4b7d-861c-511a7d360896\") "
Jul 29 04:23:28.406669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.406645    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a48fb4d2-27a4-4b7d-861c-511a7d360896" (UID: "a48fb4d2-27a4-4b7d-861c-511a7d360896"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:23:28.408312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.408289    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6" (OuterVolumeSpecName: "kube-api-access-w62n6") pod "a48fb4d2-27a4-4b7d-861c-511a7d360896" (UID: "a48fb4d2-27a4-4b7d-861c-511a7d360896"). InnerVolumeSpecName "kube-api-access-w62n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:23:28.507658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.507602    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a48fb4d2-27a4-4b7d-861c-511a7d360896-extensions-socket-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:23:28.507658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:28.507624    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w62n6\" (UniqueName: \"kubernetes.io/projected/a48fb4d2-27a4-4b7d-861c-511a7d360896-kube-api-access-w62n6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:23:29.196439 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:29.196407    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"
Jul 29 04:23:29.196911 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:29.196443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds" event={"ID":"a48fb4d2-27a4-4b7d-861c-511a7d360896","Type":"ContainerDied","Data":"ac40cb7b2203ad6da39b49f30507281804d693b2c418144cfb94c5a08206cf58"}
Jul 29 04:23:29.196911 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:29.196515    2578 scope.go:117] "RemoveContainer" containerID="0913695536f64c9281c28df375dae6f0d385eaa574e0170605bf125f017466bd"
Jul 29 04:23:29.218956 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:29.218933    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:23:29.225309 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:29.225291    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-n6jds"]
Jul 29 04:23:30.174363 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:30.174335    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:23:30.175573 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:30.175550    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:23:30.195998 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:23:30.195973    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a48fb4d2-27a4-4b7d-861c-511a7d360896" path="/var/lib/kubelet/pods/a48fb4d2-27a4-4b7d-861c-511a7d360896/volumes"
Jul 29 04:24:59.222153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:24:59.222122    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:24:59.309520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:24:59.309487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:26:46.099603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:26:46.099569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:28:08.920698 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:08.920665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:28:20.609348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:20.609315    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:28:30.208368 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:30.208343    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:28:30.211876 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:30.211852    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:28:44.412482 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:44.412439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:28:45.968788 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:28:45.968735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:30:00.143025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.142985    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"]
Jul 29 04:30:00.145424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.143462    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a48fb4d2-27a4-4b7d-861c-511a7d360896" containerName="manager"
Jul 29 04:30:00.145424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.143479    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a48fb4d2-27a4-4b7d-861c-511a7d360896" containerName="manager"
Jul 29 04:30:00.145424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.143558    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a48fb4d2-27a4-4b7d-861c-511a7d360896" containerName="manager"
Jul 29 04:30:00.146396 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.146377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"
Jul 29 04:30:00.149026 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.149006    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:30:00.155437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.155412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"]
Jul 29 04:30:00.157464 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.157447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"
Jul 29 04:30:00.295063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.295033    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"]
Jul 29 04:30:00.296474 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:30:00.296446    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e5b1e17_3047_406e_99c1_b16b725ae76c.slice/crio-9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979 WatchSource:0}: Error finding container 9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979: Status 404 returned error can't find the container with id 9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979
Jul 29 04:30:00.298454 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:00.298432    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:30:01.164928 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:01.164897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989" event={"ID":"5e5b1e17-3047-406e-99c1-b16b725ae76c","Type":"ContainerStarted","Data":"9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979"}
Jul 29 04:30:03.177179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:03.177137    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989" event={"ID":"5e5b1e17-3047-406e-99c1-b16b725ae76c","Type":"ContainerStarted","Data":"effcd2f2bba218b9af403892f9e36690bb68887fe54706e6b102fd77a2d70449"}
Jul 29 04:30:03.193304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:03.193249    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989" podStartSLOduration=0.773064677 podStartE2EDuration="3.193230782s" totalImagesPullingTime="2.420166105s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:30:03.190505972 +0000 UTC m=+1593.465522759" watchObservedRunningTime="2026-07-29 04:30:03.193230782 +0000 UTC m=+1593.468247604"
Jul 29 04:30:04.183660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:04.183618    2578 generic.go:356] "Generic (PLEG): container finished" podID="5e5b1e17-3047-406e-99c1-b16b725ae76c" containerID="effcd2f2bba218b9af403892f9e36690bb68887fe54706e6b102fd77a2d70449" exitCode=0
Jul 29 04:30:04.184071 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:04.183697    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989" event={"ID":"5e5b1e17-3047-406e-99c1-b16b725ae76c","Type":"ContainerDied","Data":"effcd2f2bba218b9af403892f9e36690bb68887fe54706e6b102fd77a2d70449"}
Jul 29 04:30:05.321568 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:05.321544    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"
Jul 29 04:30:06.195764 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:06.195730    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989"
Jul 29 04:30:06.195968 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:06.195780    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29754990-mj989" event={"ID":"5e5b1e17-3047-406e-99c1-b16b725ae76c","Type":"ContainerDied","Data":"9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979"}
Jul 29 04:30:06.195968 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:30:06.195825    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a2d7c6fbf927e683983c15caa6424b1b17112de4968071b8bed4cd924417979"
Jul 29 04:32:44.821663 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:32:44.821624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:21.153975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:21.153936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:24.061728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:24.061610    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:24.152615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:24.152577    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:24.485707 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:24.485605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:30.244061 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.244033    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:33:30.245409 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.245390    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:33:30.383985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.383953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:30.483979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.483944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:30.602847 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.602810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:30.872146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.872068    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:33:30.872452 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.872438    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e5b1e17-3047-406e-99c1-b16b725ae76c" containerName="cleanup"
Jul 29 04:33:30.872494 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.872454    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e5b1e17-3047-406e-99c1-b16b725ae76c" containerName="cleanup"
Jul 29 04:33:30.872531 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.872520    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e5b1e17-3047-406e-99c1-b16b725ae76c" containerName="cleanup"
Jul 29 04:33:30.875615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.875597    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.878012 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.877988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8ecf692c-openshift-default-dockercfg-p845t\""
Jul 29 04:33:30.892975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.892951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:33:30.898686 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.898662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:30.926323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926381    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926406    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926427    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926663 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926663 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.926663 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.926536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rjr4p\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:30.952110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:30.952064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:31.027984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.027959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.027996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028190    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028359 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rjr4p\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028495    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028552    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.028730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.029029 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.028980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.030652 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.030631    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.031030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.031013    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.035855 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.035833    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.036051 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.036035    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rjr4p\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p\") pod \"e2e-ait-8ecf692c-openshift-default-878868864-z8w47\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") " pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.186692 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.186629    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:31.322604 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:31.322567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:33:31.323119 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:33:31.323098    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd510138_7cd9_4c76_8186_79da99ea24d0.slice/crio-58214fd010bdb335f65c8c9bb647e17b861f2fd336333b1f90b2402a25bcbf71 WatchSource:0}: Error finding container 58214fd010bdb335f65c8c9bb647e17b861f2fd336333b1f90b2402a25bcbf71: Status 404 returned error can't find the container with id 58214fd010bdb335f65c8c9bb647e17b861f2fd336333b1f90b2402a25bcbf71
Jul 29 04:33:32.232353 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:32.232318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerStarted","Data":"58214fd010bdb335f65c8c9bb647e17b861f2fd336333b1f90b2402a25bcbf71"}
Jul 29 04:33:34.161131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:34.161092    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:34.161554 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:34.161174    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:34.161554 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:34.161220    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:34.246983 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:34.246950    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerStarted","Data":"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"}
Jul 29 04:33:34.267577 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:34.267520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podStartSLOduration=1.4320250429999999 podStartE2EDuration="4.267501344s" totalImagesPullingTime="2.835476301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:33:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:33:34.266626316 +0000 UTC m=+1804.541643104" watchObservedRunningTime="2026-07-29 04:33:34.267501344 +0000 UTC m=+1804.542518132"
Jul 29 04:33:35.187465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.187430    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:35.192226 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.192204    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:35.251808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.251781    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:35.252628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.252605    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:35.604051 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.604017    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:35.704977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.704944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:35.792633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.792602    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:33:35.796290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.796272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.798656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.798641    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:33:35.798770 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.798728    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-8ecf692c-serving-cert\""
Jul 29 04:33:35.799695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.799680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:33:35.799767 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.799708    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:33:35.804255 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.804232    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:33:35.812312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.812287    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:35.869852 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.869785    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.869947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.869902    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5257r\" (UniqueName: \"kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.869999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.869948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.971030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.970997    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5257r\" (UniqueName: \"kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.971171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.971036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.971171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.971058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.971702 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.971678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.973667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.973636    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:35.979046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:35.979026    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5257r\" (UniqueName: \"kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r\") pod \"maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:36.013323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.013295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:36.107492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.107464    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:36.238425 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.238400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:33:36.240034 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:33:36.240008    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c1b7eab_4bfd_4508_b613_f34246985c62.slice/crio-6cf189fa326e1f487c72a921ded28e141039981b62f6b6fc18b46c1c001680b0 WatchSource:0}: Error finding container 6cf189fa326e1f487c72a921ded28e141039981b62f6b6fc18b46c1c001680b0: Status 404 returned error can't find the container with id 6cf189fa326e1f487c72a921ded28e141039981b62f6b6fc18b46c1c001680b0
Jul 29 04:33:36.258523 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.258500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" event={"ID":"2c1b7eab-4bfd-4508-b613-f34246985c62","Type":"ContainerStarted","Data":"6cf189fa326e1f487c72a921ded28e141039981b62f6b6fc18b46c1c001680b0"}
Jul 29 04:33:36.287951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.287921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:36.384982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.384918    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:33:36.386444 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.386418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:33:36.389679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.389661    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.392037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.392018    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-8ecf692c\""
Jul 29 04:33:36.392111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.392097    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-8ecf692c-dockercfg-zm4qt\""
Jul 29 04:33:36.399437 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.399420    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:33:36.442727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.442701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:33:36.446008 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.445993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.454501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.454480    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:33:36.476488 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.476463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d5nz6\" (UniqueName: \"kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.476602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.476516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.576951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.576919    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d5nz6\" (UniqueName: \"kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.577110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.576996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.577110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.577060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.577188 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.577128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gngbb\" (UniqueName: \"kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.577735 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.577717    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.586081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.586060    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d5nz6\" (UniqueName: \"kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6\") pod \"payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.678376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.678320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.678376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.678360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gngbb\" (UniqueName: \"kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.678979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.678961    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.687519 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.687501    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gngbb\" (UniqueName: \"kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb\") pod \"payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") " pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.701155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.701133    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:36.756585 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.756558    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:36.838931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.838879    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:33:36.840893 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:33:36.840845    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72696314_aa99_4697_bf0e_13d7981f3f7e.slice/crio-ca70506a1f2059a454c09afbc038e699948d1e2b3e593ed9a829c24c3dad7495 WatchSource:0}: Error finding container ca70506a1f2059a454c09afbc038e699948d1e2b3e593ed9a829c24c3dad7495: Status 404 returned error can't find the container with id ca70506a1f2059a454c09afbc038e699948d1e2b3e593ed9a829c24c3dad7495
Jul 29 04:33:36.913039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:36.913010    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:33:36.915901 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:33:36.915630    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26073395_4da0_4cbf_a1c0_99c981f835ad.slice/crio-dfed69f895b4b83f7990fc36aec38016e6541e85d28ac3ebac30bab3c5268f75 WatchSource:0}: Error finding container dfed69f895b4b83f7990fc36aec38016e6541e85d28ac3ebac30bab3c5268f75: Status 404 returned error can't find the container with id dfed69f895b4b83f7990fc36aec38016e6541e85d28ac3ebac30bab3c5268f75
Jul 29 04:33:37.268412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.268374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" event={"ID":"72696314-aa99-4697-bf0e-13d7981f3f7e","Type":"ContainerStarted","Data":"18ecc36df7b6975adbd945ba10152b65f543031245dac010daa712efdce5b69b"}
Jul 29 04:33:37.268899 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.268442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" event={"ID":"72696314-aa99-4697-bf0e-13d7981f3f7e","Type":"ContainerStarted","Data":"ca70506a1f2059a454c09afbc038e699948d1e2b3e593ed9a829c24c3dad7495"}
Jul 29 04:33:37.268899 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.268559    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:37.271725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.271695    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" event={"ID":"26073395-4da0-4cbf-a1c0-99c981f835ad","Type":"ContainerStarted","Data":"248017747af212a8e97d0cb6e13cdbcd463fa1525300500816a962bd93b7bfbd"}
Jul 29 04:33:37.271864 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.271765    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:37.271864 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.271797    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" event={"ID":"26073395-4da0-4cbf-a1c0-99c981f835ad","Type":"ContainerStarted","Data":"dfed69f895b4b83f7990fc36aec38016e6541e85d28ac3ebac30bab3c5268f75"}
Jul 29 04:33:37.284138 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.284021    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" podStartSLOduration=1.284003142 podStartE2EDuration="1.284003142s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:33:37.283724526 +0000 UTC m=+1807.558741327" watchObservedRunningTime="2026-07-29 04:33:37.284003142 +0000 UTC m=+1807.559019931"
Jul 29 04:33:37.298507 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:37.298458    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" podStartSLOduration=1.298440827 podStartE2EDuration="1.298440827s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:33:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:33:37.297768479 +0000 UTC m=+1807.572785269" watchObservedRunningTime="2026-07-29 04:33:37.298440827 +0000 UTC m=+1807.573457619"
Jul 29 04:33:39.283902 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:39.283869    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" event={"ID":"2c1b7eab-4bfd-4508-b613-f34246985c62","Type":"ContainerStarted","Data":"ae02da5344aed0d200a134e8d140ccad1d5b47817c39129557c5beaf6a6cd778"}
Jul 29 04:33:39.284258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:39.284000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:39.300364 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:39.300320    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" podStartSLOduration=1.943001929 podStartE2EDuration="4.300305838s" totalImagesPullingTime="2.357303909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:33:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:33:39.298316367 +0000 UTC m=+1809.573333177" watchObservedRunningTime="2026-07-29 04:33:39.300305838 +0000 UTC m=+1809.575322624"
Jul 29 04:33:45.296274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:45.296243    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:33:47.326290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.326235    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerID="2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790" exitCode=0
Jul 29 04:33:47.326629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.326306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerDied","Data":"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"}
Jul 29 04:33:47.326629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.326597    2578 scope.go:117] "RemoveContainer" containerID="2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"
Jul 29 04:33:47.327519 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.327492    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:47.327574 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.327560    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:47.327614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:47.327607    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:33:48.279268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:48.279240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:33:48.279466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:48.279349    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:33:48.356282 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:48.356245    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerStarted","Data":"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"}
Jul 29 04:33:49.186823 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:49.186788    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:49.188001 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:49.187973    2578 patch_prober.go:28] interesting pod/e2e-ait-8ecf692c-openshift-default-878868864-z8w47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:33:49.188118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:49.188026    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 04:33:50.187015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:50.186981    2578 patch_prober.go:28] interesting pod/e2e-ait-8ecf692c-openshift-default-878868864-z8w47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:33:50.187403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:50.187033    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 04:33:50.252584 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:50.252547    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:51.187303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:51.187269    2578 patch_prober.go:28] interesting pod/e2e-ait-8ecf692c-openshift-default-878868864-z8w47 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused" start-of-body=
Jul 29 04:33:51.187843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:51.187331    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.44:15021/healthz/ready\": dial tcp 10.132.0.44:15021: connect: connection refused"
Jul 29 04:33:52.195826 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:52.195798    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:33:52.196695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:33:52.196673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:34:06.255852 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.255812    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:34:06.256418 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.256060    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" podUID="2c1b7eab-4bfd-4508-b613-f34246985c62" containerName="maas-api" containerID="cri-o://ae02da5344aed0d200a134e8d140ccad1d5b47817c39129557c5beaf6a6cd778" gracePeriod=30
Jul 29 04:34:06.289330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.289293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.324638 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.324604    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:34:06.324879 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.324848    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" podUID="26073395-4da0-4cbf-a1c0-99c981f835ad" containerName="payload-processing" containerID="cri-o://248017747af212a8e97d0cb6e13cdbcd463fa1525300500816a962bd93b7bfbd" gracePeriod=30
Jul 29 04:34:06.329789 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.329763    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:34:06.329979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.329952    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" podUID="72696314-aa99-4697-bf0e-13d7981f3f7e" containerName="payload-pre-processing" containerID="cri-o://18ecc36df7b6975adbd945ba10152b65f543031245dac010daa712efdce5b69b" gracePeriod=30
Jul 29 04:34:06.363767 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.363714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.452985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.452956    2578 generic.go:356] "Generic (PLEG): container finished" podID="2c1b7eab-4bfd-4508-b613-f34246985c62" containerID="ae02da5344aed0d200a134e8d140ccad1d5b47817c39129557c5beaf6a6cd778" exitCode=0
Jul 29 04:34:06.453122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.453029    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" event={"ID":"2c1b7eab-4bfd-4508-b613-f34246985c62","Type":"ContainerDied","Data":"ae02da5344aed0d200a134e8d140ccad1d5b47817c39129557c5beaf6a6cd778"}
Jul 29 04:34:06.455088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.455062    2578 generic.go:356] "Generic (PLEG): container finished" podID="26073395-4da0-4cbf-a1c0-99c981f835ad" containerID="248017747af212a8e97d0cb6e13cdbcd463fa1525300500816a962bd93b7bfbd" exitCode=0
Jul 29 04:34:06.455202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.455138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" event={"ID":"26073395-4da0-4cbf-a1c0-99c981f835ad","Type":"ContainerDied","Data":"248017747af212a8e97d0cb6e13cdbcd463fa1525300500816a962bd93b7bfbd"}
Jul 29 04:34:06.457050 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.457030    2578 generic.go:356] "Generic (PLEG): container finished" podID="72696314-aa99-4697-bf0e-13d7981f3f7e" containerID="18ecc36df7b6975adbd945ba10152b65f543031245dac010daa712efdce5b69b" exitCode=0
Jul 29 04:34:06.457157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.457081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" event={"ID":"72696314-aa99-4697-bf0e-13d7981f3f7e","Type":"ContainerDied","Data":"18ecc36df7b6975adbd945ba10152b65f543031245dac010daa712efdce5b69b"}
Jul 29 04:34:06.472835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.472681    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.529192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.529160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.578151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.578121    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:34:06.578445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.578381    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy" containerID="cri-o://448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871" gracePeriod=30
Jul 29 04:34:06.603334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.603268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.622334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.622309    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:34:06.636870 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.636848    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:34:06.648176 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.648155    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:34:06.743739 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.743712    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5257r\" (UniqueName: \"kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r\") pod \"2c1b7eab-4bfd-4508-b613-f34246985c62\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") "
Jul 29 04:34:06.743937 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.743775    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca\") pod \"2c1b7eab-4bfd-4508-b613-f34246985c62\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") "
Jul 29 04:34:06.743937 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.743798    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume\") pod \"26073395-4da0-4cbf-a1c0-99c981f835ad\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") "
Jul 29 04:34:06.743937 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.743836    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls\") pod \"2c1b7eab-4bfd-4508-b613-f34246985c62\" (UID: \"2c1b7eab-4bfd-4508-b613-f34246985c62\") "
Jul 29 04:34:06.743937 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.743919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gngbb\" (UniqueName: \"kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb\") pod \"26073395-4da0-4cbf-a1c0-99c981f835ad\" (UID: \"26073395-4da0-4cbf-a1c0-99c981f835ad\") "
Jul 29 04:34:06.744231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.744204    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2c1b7eab-4bfd-4508-b613-f34246985c62" (UID: "2c1b7eab-4bfd-4508-b613-f34246985c62"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:06.744291 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.744220    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "26073395-4da0-4cbf-a1c0-99c981f835ad" (UID: "26073395-4da0-4cbf-a1c0-99c981f835ad"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:06.746055 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.746023    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r" (OuterVolumeSpecName: "kube-api-access-5257r") pod "2c1b7eab-4bfd-4508-b613-f34246985c62" (UID: "2c1b7eab-4bfd-4508-b613-f34246985c62"). InnerVolumeSpecName "kube-api-access-5257r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:06.746149 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.746086    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2c1b7eab-4bfd-4508-b613-f34246985c62" (UID: "2c1b7eab-4bfd-4508-b613-f34246985c62"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:34:06.746149 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.746113    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb" (OuterVolumeSpecName: "kube-api-access-gngbb") pod "26073395-4da0-4cbf-a1c0-99c981f835ad" (UID: "26073395-4da0-4cbf-a1c0-99c981f835ad"). InnerVolumeSpecName "kube-api-access-gngbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:06.810469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.810402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:06.845412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume\") pod \"72696314-aa99-4697-bf0e-13d7981f3f7e\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") "
Jul 29 04:34:06.845496 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845439    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d5nz6\" (UniqueName: \"kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6\") pod \"72696314-aa99-4697-bf0e-13d7981f3f7e\" (UID: \"72696314-aa99-4697-bf0e-13d7981f3f7e\") "
Jul 29 04:34:06.845609 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845595    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5257r\" (UniqueName: \"kubernetes.io/projected/2c1b7eab-4bfd-4508-b613-f34246985c62-kube-api-access-5257r\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.845712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845610    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2c1b7eab-4bfd-4508-b613-f34246985c62-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.845712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845621    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/26073395-4da0-4cbf-a1c0-99c981f835ad-plugins-config-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.845712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845634    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2c1b7eab-4bfd-4508-b613-f34246985c62-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.845712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845653    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gngbb\" (UniqueName: \"kubernetes.io/projected/26073395-4da0-4cbf-a1c0-99c981f835ad-kube-api-access-gngbb\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.845712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.845706    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72696314-aa99-4697-bf0e-13d7981f3f7e" (UID: "72696314-aa99-4697-bf0e-13d7981f3f7e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:06.847223 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.847202    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6" (OuterVolumeSpecName: "kube-api-access-d5nz6") pod "72696314-aa99-4697-bf0e-13d7981f3f7e" (UID: "72696314-aa99-4697-bf0e-13d7981f3f7e"). InnerVolumeSpecName "kube-api-access-d5nz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:06.946900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.946878    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72696314-aa99-4697-bf0e-13d7981f3f7e-plugins-config-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:06.946900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:06.946896    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d5nz6\" (UniqueName: \"kubernetes.io/projected/72696314-aa99-4697-bf0e-13d7981f3f7e-kube-api-access-d5nz6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:07.056165 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.056137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:07.157274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.157191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:07.197813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.197786    2578 patch_prober.go:28] interesting pod/e2e-ait-8ecf692c-openshift-default-878868864-z8w47 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:34:07.197922 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.197835    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:34:07.257728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.257676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:07.464000 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.463930    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"
Jul 29 04:34:07.464000 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.463963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj" event={"ID":"72696314-aa99-4697-bf0e-13d7981f3f7e","Type":"ContainerDied","Data":"ca70506a1f2059a454c09afbc038e699948d1e2b3e593ed9a829c24c3dad7495"}
Jul 29 04:34:07.464173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.464031    2578 scope.go:117] "RemoveContainer" containerID="18ecc36df7b6975adbd945ba10152b65f543031245dac010daa712efdce5b69b"
Jul 29 04:34:07.465290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.465275    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"
Jul 29 04:34:07.465371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.465294    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz" event={"ID":"2c1b7eab-4bfd-4508-b613-f34246985c62","Type":"ContainerDied","Data":"6cf189fa326e1f487c72a921ded28e141039981b62f6b6fc18b46c1c001680b0"}
Jul 29 04:34:07.466859 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.466825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb" event={"ID":"26073395-4da0-4cbf-a1c0-99c981f835ad","Type":"ContainerDied","Data":"dfed69f895b4b83f7990fc36aec38016e6541e85d28ac3ebac30bab3c5268f75"}
Jul 29 04:34:07.466997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.466833    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"
Jul 29 04:34:07.475207 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.475193    2578 scope.go:117] "RemoveContainer" containerID="ae02da5344aed0d200a134e8d140ccad1d5b47817c39129557c5beaf6a6cd778"
Jul 29 04:34:07.486192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.486175    2578 scope.go:117] "RemoveContainer" containerID="248017747af212a8e97d0cb6e13cdbcd463fa1525300500816a962bd93b7bfbd"
Jul 29 04:34:07.492933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.492687    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:07.493880 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493856    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26073395-4da0-4cbf-a1c0-99c981f835ad" containerName="payload-processing"
Jul 29 04:34:07.493880 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493882    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="26073395-4da0-4cbf-a1c0-99c981f835ad" containerName="payload-processing"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493901    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72696314-aa99-4697-bf0e-13d7981f3f7e" containerName="payload-pre-processing"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493910    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="72696314-aa99-4697-bf0e-13d7981f3f7e" containerName="payload-pre-processing"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493932    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c1b7eab-4bfd-4508-b613-f34246985c62" containerName="maas-api"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.493941    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c1b7eab-4bfd-4508-b613-f34246985c62" containerName="maas-api"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.494017    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="72696314-aa99-4697-bf0e-13d7981f3f7e" containerName="payload-pre-processing"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.494027    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c1b7eab-4bfd-4508-b613-f34246985c62" containerName="maas-api"
Jul 29 04:34:07.494114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.494038    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="26073395-4da0-4cbf-a1c0-99c981f835ad" containerName="payload-processing"
Jul 29 04:34:07.498923 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.498893    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:34:07.499006 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.498986    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.500288 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.500270    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-8ecf692c-5c95855488-z45vj"]
Jul 29 04:34:07.501440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.501423    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-a3bf19b0-gw-openshift-default-dockercfg-88792\""
Jul 29 04:34:07.507769 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.507735    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:07.514808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.514786    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:34:07.521325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.521305    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-8ecf692c-59b8d964bd-lqvzb"]
Jul 29 04:34:07.521575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.521549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:07.531399 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.531381    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:34:07.537483 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.537461    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-8ecf692c-7cdcc5f659-z2gxz"]
Jul 29 04:34:07.551347 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551306    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551394    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551477 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tm52g\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551664 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551522    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551664 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551664 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.551854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.551688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652485 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652485 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652486    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tm52g\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652567    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652595    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.652719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.652850    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653133 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.653088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.653120    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.653158    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653267 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.653238    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.653301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.653252    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.654970 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.654939    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.655071 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.655020    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.662872 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.662848    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tm52g\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.663192 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.663176    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token\") pod \"e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") " pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.778926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.778884    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:07.809798 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.809774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:07.942144 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.942119    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:07.943337 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:34:07.943309    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cf0de6f_602e_4b95_91c9_ef8f0fdd86db.slice/crio-35168e338a904068b7b0aa7d69db0df480e1fa19a9795b807599ebf2fd81bc6f WatchSource:0}: Error finding container 35168e338a904068b7b0aa7d69db0df480e1fa19a9795b807599ebf2fd81bc6f: Status 404 returned error can't find the container with id 35168e338a904068b7b0aa7d69db0df480e1fa19a9795b807599ebf2fd81bc6f
Jul 29 04:34:07.945388 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.945357    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:07.945440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.945421    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:07.945480 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:07.945448    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:08.195977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.195895    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26073395-4da0-4cbf-a1c0-99c981f835ad" path="/var/lib/kubelet/pods/26073395-4da0-4cbf-a1c0-99c981f835ad/volumes"
Jul 29 04:34:08.196303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.196289    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c1b7eab-4bfd-4508-b613-f34246985c62" path="/var/lib/kubelet/pods/2c1b7eab-4bfd-4508-b613-f34246985c62/volumes"
Jul 29 04:34:08.196595 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.196583    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72696314-aa99-4697-bf0e-13d7981f3f7e" path="/var/lib/kubelet/pods/72696314-aa99-4697-bf0e-13d7981f3f7e/volumes"
Jul 29 04:34:08.475892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.475814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerStarted","Data":"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"}
Jul 29 04:34:08.475892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.475858    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerStarted","Data":"35168e338a904068b7b0aa7d69db0df480e1fa19a9795b807599ebf2fd81bc6f"}
Jul 29 04:34:08.495196 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.495147    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podStartSLOduration=1.495132242 podStartE2EDuration="1.495132242s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:34:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:34:08.494694487 +0000 UTC m=+1838.769711275" watchObservedRunningTime="2026-07-29 04:34:08.495132242 +0000 UTC m=+1838.770149027"
Jul 29 04:34:08.498981 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.498957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:08.810292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:08.810263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:09.815234 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:09.815207    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:09.924835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:09.924797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:10.010996 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.010961    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:10.016243 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.016215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.019018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.018996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-a3bf19b0-serving-cert\""
Jul 29 04:34:10.019122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.018998    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:34:10.019122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.019037    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:34:10.019122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.019020    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:34:10.024676 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.024362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:10.041318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.041284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:10.078115 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.078052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.078115 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.078081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l5fr\" (UniqueName: \"kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.078247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.078138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.179378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.179343    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.179378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.179375    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l5fr\" (UniqueName: \"kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.179585 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.179411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.179585 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:10.179501    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-serving-cert: secret "maas-api-e2e-migrate-a3bf19b0-serving-cert" not found
Jul 29 04:34:10.179585 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:10.179553    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls podName:f8a56ea3-e00a-48be-ae20-5f182a8348bd nodeName:}" failed. No retries permitted until 2026-07-29 04:34:10.679538802 +0000 UTC m=+1840.954555571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls") pod "maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" (UID: "f8a56ea3-e00a-48be-ae20-5f182a8348bd") : secret "maas-api-e2e-migrate-a3bf19b0-serving-cert" not found
Jul 29 04:34:10.180107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.180088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.189819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.189796    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l5fr\" (UniqueName: \"kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.487024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.486942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:10.487771 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.487730    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:10.599676 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.599641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:10.684042 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.684017    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.686306 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.686289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") pod \"maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:10.700373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.700342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:10.783921 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.783896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:10.928673 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:10.928642    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:11.066644 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:34:11.066617    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8a56ea3_e00a_48be_ae20_5f182a8348bd.slice/crio-8d3851a6f1e8e96b9c111cb2fc45a6468460aadc3944c482ad7c91655656a011 WatchSource:0}: Error finding container 8d3851a6f1e8e96b9c111cb2fc45a6468460aadc3944c482ad7c91655656a011: Status 404 returned error can't find the container with id 8d3851a6f1e8e96b9c111cb2fc45a6468460aadc3944c482ad7c91655656a011
Jul 29 04:34:11.067363 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.067333    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:11.498035 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.498005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" event={"ID":"f8a56ea3-e00a-48be-ae20-5f182a8348bd","Type":"ContainerStarted","Data":"3d65ae33e19e7aa57d685c0f753e712047ee46a689b82c3af310b823ded22478"}
Jul 29 04:34:11.498154 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.498093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" event={"ID":"f8a56ea3-e00a-48be-ae20-5f182a8348bd","Type":"ContainerStarted","Data":"8d3851a6f1e8e96b9c111cb2fc45a6468460aadc3944c482ad7c91655656a011"}
Jul 29 04:34:11.514885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.514843    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" podStartSLOduration=2.155813952 podStartE2EDuration="2.514830135s" totalImagesPullingTime="359.016183ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:34:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:34:11.5134241 +0000 UTC m=+1841.788440887" watchObservedRunningTime="2026-07-29 04:34:11.514830135 +0000 UTC m=+1841.789846924"
Jul 29 04:34:11.828111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.828085    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:34:11.893957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.893930    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894071    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894092    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rjr4p\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894183    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894254    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894313    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data\") pod \"cd510138-7cd9-4c76-8186-79da99ea24d0\" (UID: \"cd510138-7cd9-4c76-8186-79da99ea24d0\") "
Jul 29 04:34:11.894490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894467    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:11.894596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:11.894661 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894565    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:11.894661 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:11.894858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894836    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.894952 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894861    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.894952 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894876    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.894952 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.894889    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cd510138-7cd9-4c76-8186-79da99ea24d0-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.895361 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.895341    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:11.896662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.896630    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:34:11.896741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.896669    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:11.896741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.896686    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:11.896741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.896689    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p" (OuterVolumeSpecName: "kube-api-access-rjr4p") pod "cd510138-7cd9-4c76-8186-79da99ea24d0" (UID: "cd510138-7cd9-4c76-8186-79da99ea24d0"). InnerVolumeSpecName "kube-api-access-rjr4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:11.995503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.995448    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.995503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.995469    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rjr4p\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-kube-api-access-rjr4p\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.995503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.995479    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.995503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.995487    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:11.995503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:11.995495    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cd510138-7cd9-4c76-8186-79da99ea24d0-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:12.505136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505105    2578 generic.go:356] "Generic (PLEG): container finished" podID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerID="448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871" exitCode=0
Jul 29 04:34:12.505292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505148    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"
Jul 29 04:34:12.505292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerDied","Data":"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"}
Jul 29 04:34:12.505292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505239    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47" event={"ID":"cd510138-7cd9-4c76-8186-79da99ea24d0","Type":"ContainerDied","Data":"58214fd010bdb335f65c8c9bb647e17b861f2fd336333b1f90b2402a25bcbf71"}
Jul 29 04:34:12.505292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505263    2578 scope.go:117] "RemoveContainer" containerID="448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"
Jul 29 04:34:12.505525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.505496    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:12.513997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.513978    2578 scope.go:117] "RemoveContainer" containerID="2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"
Jul 29 04:34:12.521965 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.521946    2578 scope.go:117] "RemoveContainer" containerID="448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"
Jul 29 04:34:12.522224 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:12.522203    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871\": container with ID starting with 448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871 not found: ID does not exist" containerID="448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"
Jul 29 04:34:12.522285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.522232    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871"} err="failed to get container status \"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871\": rpc error: code = NotFound desc = could not find container \"448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871\": container with ID starting with 448eeb558b8a3f659104862850ce37692cf08d37f0baacee2af1a00051965871 not found: ID does not exist"
Jul 29 04:34:12.522285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.522248    2578 scope.go:117] "RemoveContainer" containerID="2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"
Jul 29 04:34:12.522435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.522418    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:34:12.522484 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:12.522470    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790\": container with ID starting with 2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790 not found: ID does not exist" containerID="2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"
Jul 29 04:34:12.522518 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.522490    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790"} err="failed to get container status \"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790\": rpc error: code = NotFound desc = could not find container \"2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790\": container with ID starting with 2495713c8bf275075631bf3e093b5f9e5201bd82628328e75e5bbd10a1f4e790 not found: ID does not exist"
Jul 29 04:34:12.525725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:12.525705    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8ecf692c-openshift-default-878868864-z8w47"]
Jul 29 04:34:14.195609 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:14.195578    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" path="/var/lib/kubelet/pods/cd510138-7cd9-4c76-8186-79da99ea24d0/volumes"
Jul 29 04:34:18.517127 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:18.517097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:24.577868 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.577839    2578 generic.go:356] "Generic (PLEG): container finished" podID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerID="7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383" exitCode=0
Jul 29 04:34:24.578317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.577916    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerDied","Data":"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"}
Jul 29 04:34:24.578317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.578296    2578 scope.go:117] "RemoveContainer" containerID="7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"
Jul 29 04:34:24.579365 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.579327    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:24.579485 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.579414    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:24.579485 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:24.579463    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:25.486975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:25.486947    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:25.585435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:25.585396    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerStarted","Data":"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"}
Jul 29 04:34:25.810124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:25.810083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:25.811277 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:25.811248    2578 patch_prober.go:28] interesting pod/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 04:34:25.811399 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:25.811312    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 04:34:26.810675 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:26.810633    2578 patch_prober.go:28] interesting pod/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 04:34:26.811114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:26.810705    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 04:34:27.811166 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:27.811129    2578 patch_prober.go:28] interesting pod/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 04:34:27.811549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:27.811182    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 04:34:28.810169 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:28.810135    2578 patch_prober.go:28] interesting pod/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused" start-of-body=
Jul 29 04:34:28.810345 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:28.810196    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.48:15021/healthz/ready\": dial tcp 10.132.0.48:15021: connect: connection refused"
Jul 29 04:34:29.814564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:29.814530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:29.814997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:29.814974    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:29.815655 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:29.815637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:34.913470 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.913436    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"]
Jul 29 04:34:34.913869 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.913824    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:34.913869 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.913840    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:34.913947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.913907    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:34.913947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.913919    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:34.915907 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.915891    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:34.918218 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.918185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:34:34.922840 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.922806    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"]
Jul 29 04:34:34.995373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:34.995349    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr\" (UID: \"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:35.096018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.095991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr\" (UID: \"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:35.096545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.096526    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr\" (UID: \"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:35.227323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.227263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:35.353844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.353818    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"]
Jul 29 04:34:35.354892 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:34:35.354865    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2505dbc3_dc1f_4aa4_a76a_13a23efe6f6b.slice/crio-3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e WatchSource:0}: Error finding container 3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e: Status 404 returned error can't find the container with id 3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e
Jul 29 04:34:35.644933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.644902    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr" event={"ID":"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b","Type":"ContainerStarted","Data":"a125282e34d012d21aa9e75c731fe630c1ff7bad09722d61d6712153431fdad5"}
Jul 29 04:34:35.645092 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.644995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr" event={"ID":"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b","Type":"ContainerStarted","Data":"3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e"}
Jul 29 04:34:35.660054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:35.660003    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr" podStartSLOduration=1.6599906610000001 podStartE2EDuration="1.659990661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:34:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:34:35.658129086 +0000 UTC m=+1865.933145874" watchObservedRunningTime="2026-07-29 04:34:35.659990661 +0000 UTC m=+1865.935007449"
Jul 29 04:34:36.651615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:36.651579    2578 generic.go:356] "Generic (PLEG): container finished" podID="2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" containerID="a125282e34d012d21aa9e75c731fe630c1ff7bad09722d61d6712153431fdad5" exitCode=0
Jul 29 04:34:36.652010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:36.651667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr" event={"ID":"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b","Type":"ContainerDied","Data":"a125282e34d012d21aa9e75c731fe630c1ff7bad09722d61d6712153431fdad5"}
Jul 29 04:34:37.790448 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:37.790423    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:37.919936 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:37.919864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca\") pod \"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b\" (UID: \"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b\") "
Jul 29 04:34:37.920197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:37.920173    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" (UID: "2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:38.021069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:38.021043    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:38.663186 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:38.663159    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"
Jul 29 04:34:38.663327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:38.663159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr" event={"ID":"2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b","Type":"ContainerDied","Data":"3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e"}
Jul 29 04:34:38.663327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:38.663275    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3d4de7122c73ec92e93b8a421234b7ded8fe648def35e8ca2185f1e063bc920e"
Jul 29 04:34:40.529977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.529947    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:40.530439 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.530177    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" podUID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" containerName="maas-api" containerID="cri-o://3d65ae33e19e7aa57d685c0f753e712047ee46a689b82c3af310b823ded22478" gracePeriod=30
Jul 29 04:34:40.548703 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.548675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:40.610717 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.610626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:40.673959 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.673920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:40.675356 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.675330    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" containerID="3d65ae33e19e7aa57d685c0f753e712047ee46a689b82c3af310b823ded22478" exitCode=0
Jul 29 04:34:40.675473 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.675395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" event={"ID":"f8a56ea3-e00a-48be-ae20-5f182a8348bd","Type":"ContainerDied","Data":"3d65ae33e19e7aa57d685c0f753e712047ee46a689b82c3af310b823ded22478"}
Jul 29 04:34:40.709539 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.709507    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"]
Jul 29 04:34:40.722567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.722541    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-a3bf19b0-shtkr"]
Jul 29 04:34:40.774618 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.774579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:40.796320 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.796298    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:40.830645 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.830617    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:40.830914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.830888    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" containerID="cri-o://dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49" gracePeriod=30
Jul 29 04:34:40.859236 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.859205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:40.943624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.943592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca\") pod \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") "
Jul 29 04:34:40.943624 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.943629    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9l5fr\" (UniqueName: \"kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr\") pod \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") "
Jul 29 04:34:40.943877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.943666    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") pod \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\" (UID: \"f8a56ea3-e00a-48be-ae20-5f182a8348bd\") "
Jul 29 04:34:40.944051 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.944024    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f8a56ea3-e00a-48be-ae20-5f182a8348bd" (UID: "f8a56ea3-e00a-48be-ae20-5f182a8348bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:40.946073 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.946014    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr" (OuterVolumeSpecName: "kube-api-access-9l5fr") pod "f8a56ea3-e00a-48be-ae20-5f182a8348bd" (UID: "f8a56ea3-e00a-48be-ae20-5f182a8348bd"). InnerVolumeSpecName "kube-api-access-9l5fr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:40.946197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:40.946110    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f8a56ea3-e00a-48be-ae20-5f182a8348bd" (UID: "f8a56ea3-e00a-48be-ae20-5f182a8348bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:34:41.044916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.044838    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f8a56ea3-e00a-48be-ae20-5f182a8348bd-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:41.044916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.044865    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9l5fr\" (UniqueName: \"kubernetes.io/projected/f8a56ea3-e00a-48be-ae20-5f182a8348bd-kube-api-access-9l5fr\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:41.044916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.044875    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f8a56ea3-e00a-48be-ae20-5f182a8348bd-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:41.059097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.059065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:41.287058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.287024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:41.554783 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.554740    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555075    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" containerName="maas-api"
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555087    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" containerName="maas-api"
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555106    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555112    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd510138-7cd9-4c76-8186-79da99ea24d0" containerName="istio-proxy"
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555121    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" containerName="revoke-keys"
Jul 29 04:34:41.555142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555127    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" containerName="revoke-keys"
Jul 29 04:34:41.555337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555195    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" containerName="maas-api"
Jul 29 04:34:41.555337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.555204    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" containerName="revoke-keys"
Jul 29 04:34:41.557271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.557251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.560790 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.560771    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0c9d218b-openshift-default-dockercfg-tfqdg\""
Jul 29 04:34:41.576508 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.576488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:34:41.604938 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.604918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:41.650125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650125 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zp9b\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650252    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650296    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.650546 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.650413    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.682355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.682325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92" event={"ID":"f8a56ea3-e00a-48be-ae20-5f182a8348bd","Type":"ContainerDied","Data":"8d3851a6f1e8e96b9c111cb2fc45a6468460aadc3944c482ad7c91655656a011"}
Jul 29 04:34:41.682491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.682358    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"
Jul 29 04:34:41.682491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.682382    2578 scope.go:117] "RemoveContainer" containerID="3d65ae33e19e7aa57d685c0f753e712047ee46a689b82c3af310b823ded22478"
Jul 29 04:34:41.718426 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.718402    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:41.721898 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.721875    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-a3bf19b0-7764b75dc4-dsw92"]
Jul 29 04:34:41.751877 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.751855    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.751977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.751908    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.751977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.751927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zp9b\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.751977 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.751952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.751990    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752006    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752025    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752106    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752436 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752493 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752464    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752493 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752478    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752605 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.752792 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.752772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.754203 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.754182    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.754396 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.754381    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.759265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.759247    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zp9b\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.759341 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.759324    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token\") pod \"e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") " pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.866945 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.866879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:41.888260 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:41.888219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:42.002728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.002695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:34:42.004039 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:34:42.004013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcab5e03_3bac_423e_b13b_d6ff7400a13f.slice/crio-049d1bcb0ae6ffe972f43ef5d67f0e944bbf46d4480e64b1b0f4d104fa4b72ce WatchSource:0}: Error finding container 049d1bcb0ae6ffe972f43ef5d67f0e944bbf46d4480e64b1b0f4d104fa4b72ce: Status 404 returned error can't find the container with id 049d1bcb0ae6ffe972f43ef5d67f0e944bbf46d4480e64b1b0f4d104fa4b72ce
Jul 29 04:34:42.006108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.006074    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:42.006204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.006138    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:42.006204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.006164    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:42.197001 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.196922    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b" path="/var/lib/kubelet/pods/2505dbc3-dc1f-4aa4-a76a-13a23efe6f6b/volumes"
Jul 29 04:34:42.197341 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.197327    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8a56ea3-e00a-48be-ae20-5f182a8348bd" path="/var/lib/kubelet/pods/f8a56ea3-e00a-48be-ae20-5f182a8348bd/volumes"
Jul 29 04:34:42.690930 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.690898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerStarted","Data":"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"}
Jul 29 04:34:42.691316 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.690953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerStarted","Data":"049d1bcb0ae6ffe972f43ef5d67f0e944bbf46d4480e64b1b0f4d104fa4b72ce"}
Jul 29 04:34:42.712140 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.712092    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podStartSLOduration=1.712079017 podStartE2EDuration="1.712079017s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:34:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:34:42.710601361 +0000 UTC m=+1872.985618151" watchObservedRunningTime="2026-07-29 04:34:42.712079017 +0000 UTC m=+1872.987095805"
Jul 29 04:34:42.867179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:42.867156    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:43.872717 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:43.872691    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:44.039465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.039431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.119448 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.119350    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:34:44.119714 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.119689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.122856 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.122800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.126172 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.126148    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0c9d218b-serving-cert\""
Jul 29 04:34:44.126172 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.126152    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:34:44.126349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.126157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:34:44.126349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.126238    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:34:44.134084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.134063    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:34:44.187001 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.186976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.272545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.272518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtvlx\" (UniqueName: \"kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.272683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.272549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.272782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.272698    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.287175 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.287154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.373946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.373870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.374110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.373955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtvlx\" (UniqueName: \"kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.374110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.373976    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.374573 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.374556    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.376435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.376415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.382568 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.382550    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtvlx\" (UniqueName: \"kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx\") pod \"maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.436245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.436220    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:44.596457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.596433    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:34:44.597399 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:34:44.597374    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5da4e30a_2e0f_4a39_9ab1_dcf45b7fc05e.slice/crio-9b649e69d95736cc5038195f8b5b8f1df6217f9c3de19714c52602cba7cd75db WatchSource:0}: Error finding container 9b649e69d95736cc5038195f8b5b8f1df6217f9c3de19714c52602cba7cd75db: Status 404 returned error can't find the container with id 9b649e69d95736cc5038195f8b5b8f1df6217f9c3de19714c52602cba7cd75db
Jul 29 04:34:44.632116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.632040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.705951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.705914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" event={"ID":"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e","Type":"ContainerStarted","Data":"9b649e69d95736cc5038195f8b5b8f1df6217f9c3de19714c52602cba7cd75db"}
Jul 29 04:34:44.706268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.706252    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:44.707176 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.707157    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:44.731269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.731219    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:34:44.817294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.817261    2578 patch_prober.go:28] interesting pod/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:34:44.817453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:44.817325    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:34:45.712802 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:45.712767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" event={"ID":"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e","Type":"ContainerStarted","Data":"e9f6f5780989c7c9282de878d7897d60768178c365759f59e70af6fd618462d0"}
Jul 29 04:34:45.713204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:45.713079    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:45.730032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:45.729990    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" podStartSLOduration=1.3593834 podStartE2EDuration="1.729974439s" totalImagesPullingTime="370.591039ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:34:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:34:45.728218495 +0000 UTC m=+1876.003235283" watchObservedRunningTime="2026-07-29 04:34:45.729974439 +0000 UTC m=+1876.004991235"
Jul 29 04:34:46.094031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.094009    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:46.191203 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191173    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191231    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191263    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191328    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191359    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191384    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191434    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:46.191599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191599 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tm52g\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g\") pod \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\" (UID: \"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db\") "
Jul 29 04:34:46.191885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191792    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:34:46.191885 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.191790    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:46.192080 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.192048    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.192173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.192073    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:46.192173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.192087    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.192173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.192100    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.192173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.192139    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data" (OuterVolumeSpecName: "istio-data") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:46.193683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.193653    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:34:46.193862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.193829    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:34:46.194015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.193995    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token" (OuterVolumeSpecName: "istio-token") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:46.194380 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.194352    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g" (OuterVolumeSpecName: "kube-api-access-tm52g") pod "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" (UID: "4cf0de6f-602e-4b95-91c9-ef8f0fdd86db"). InnerVolumeSpecName "kube-api-access-tm52g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:34:46.292807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292784    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.292807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292808    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.292997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292818    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.292997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292826    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tm52g\" (UniqueName: \"kubernetes.io/projected/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-kube-api-access-tm52g\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.292997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292835    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.292997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.292843    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:34:46.719354 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.719271    2578 generic.go:356] "Generic (PLEG): container finished" podID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerID="dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49" exitCode=0
Jul 29 04:34:46.719354 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.719321    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"
Jul 29 04:34:46.719807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.719361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerDied","Data":"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"}
Jul 29 04:34:46.719807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.719422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8" event={"ID":"4cf0de6f-602e-4b95-91c9-ef8f0fdd86db","Type":"ContainerDied","Data":"35168e338a904068b7b0aa7d69db0df480e1fa19a9795b807599ebf2fd81bc6f"}
Jul 29 04:34:46.719807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.719449    2578 scope.go:117] "RemoveContainer" containerID="dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"
Jul 29 04:34:46.728416 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.728399    2578 scope.go:117] "RemoveContainer" containerID="7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"
Jul 29 04:34:46.736650 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.736624    2578 scope.go:117] "RemoveContainer" containerID="dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"
Jul 29 04:34:46.736927 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:46.736906    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49\": container with ID starting with dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49 not found: ID does not exist" containerID="dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"
Jul 29 04:34:46.736972 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.736936    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49"} err="failed to get container status \"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49\": rpc error: code = NotFound desc = could not find container \"dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49\": container with ID starting with dc7ed6d087ef9252d28082b0eb6c8621463f3a3d9ce9fbfae16acd9173255a49 not found: ID does not exist"
Jul 29 04:34:46.736972 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.736951    2578 scope.go:117] "RemoveContainer" containerID="7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"
Jul 29 04:34:46.737194 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:34:46.737176    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383\": container with ID starting with 7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383 not found: ID does not exist" containerID="7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"
Jul 29 04:34:46.737240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.737201    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383"} err="failed to get container status \"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383\": rpc error: code = NotFound desc = could not find container \"7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383\": container with ID starting with 7a2a004dd3651450e0b4f6d2fb3f033e49635e83129ee94a754696ecdf7d0383 not found: ID does not exist"
Jul 29 04:34:46.738440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.738423    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:46.741953 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:46.741933    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-a3bf19b0-gw-openshift-default-6d544d94cb-8s2t8"]
Jul 29 04:34:48.196143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:48.196102    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" path="/var/lib/kubelet/pods/4cf0de6f-602e-4b95-91c9-ef8f0fdd86db/volumes"
Jul 29 04:34:51.725420 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:51.725383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:34:58.793868 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.793835    2578 generic.go:356] "Generic (PLEG): container finished" podID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerID="c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90" exitCode=0
Jul 29 04:34:58.794303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.793906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerDied","Data":"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"}
Jul 29 04:34:58.794303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.794272    2578 scope.go:117] "RemoveContainer" containerID="c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"
Jul 29 04:34:58.795252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.795227    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:58.795321 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.795294    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:58.795357 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:58.795325    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:34:59.706293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:59.706257    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:59.801565 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:59.801530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerStarted","Data":"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"}
Jul 29 04:34:59.867132 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:59.867095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:34:59.868176 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:59.868152    2578 patch_prober.go:28] interesting pod/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 04:34:59.868236 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:34:59.868204    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 04:35:00.867262 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:00.867230    2578 patch_prober.go:28] interesting pod/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 04:35:00.867656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:00.867285    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 04:35:01.867867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:01.867832    2578 patch_prober.go:28] interesting pod/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 04:35:01.868257 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:01.867884    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 04:35:02.867312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:02.867277    2578 patch_prober.go:28] interesting pod/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused" start-of-body=
Jul 29 04:35:02.867502 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:02.867332    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.51:15021/healthz/ready\": dial tcp 10.132.0.51:15021: connect: connection refused"
Jul 29 04:35:03.871025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:03.870994    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:35:03.871405 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:03.871347    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:35:03.871986 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:03.871964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:35:09.757403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757372    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"]
Jul 29 04:35:09.757795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757715    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:09.757795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757727    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:09.757795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757734    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:09.757795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757740    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:09.757950 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.757840    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:09.759810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.759794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:09.762340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.762322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:35:09.768018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.767990    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"]
Jul 29 04:35:09.799442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.799411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh\" (UID: \"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:09.899813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.899785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh\" (UID: \"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:09.900367 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:09.900348    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh\" (UID: \"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:10.071451 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:10.071429    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:10.198331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:10.198305    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"]
Jul 29 04:35:10.199558 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:35:10.199537    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ecdbb71_7af5_4742_8a38_a9f051b5dd1a.slice/crio-df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a WatchSource:0}: Error finding container df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a: Status 404 returned error can't find the container with id df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a
Jul 29 04:35:10.859111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:10.859080    2578 generic.go:356] "Generic (PLEG): container finished" podID="3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" containerID="4e5fc7fe53580f98b35e9a35c41f3d3e4aa52dd8c574737a77cade06ce872886" exitCode=0
Jul 29 04:35:10.859410 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:10.859117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh" event={"ID":"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a","Type":"ContainerDied","Data":"4e5fc7fe53580f98b35e9a35c41f3d3e4aa52dd8c574737a77cade06ce872886"}
Jul 29 04:35:10.859410 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:10.859161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh" event={"ID":"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a","Type":"ContainerStarted","Data":"df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a"}
Jul 29 04:35:11.999577 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:11.999553    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:12.116124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.116095    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca\") pod \"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a\" (UID: \"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a\") "
Jul 29 04:35:12.116428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.116404    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" (UID: "3ecdbb71-7af5-4742-8a38-a9f051b5dd1a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:12.217617 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.217588    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:12.876653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.876623    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"
Jul 29 04:35:12.876846 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.876627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh" event={"ID":"3ecdbb71-7af5-4742-8a38-a9f051b5dd1a","Type":"ContainerDied","Data":"df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a"}
Jul 29 04:35:12.876846 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:12.876764    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="df310f60ffe82f0952c4ac009d205bdc916d2e26671ce8b001175c7de69afa4a"
Jul 29 04:35:14.667306 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.667274    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:35:14.667690 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.667458    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" podUID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" containerName="maas-api" containerID="cri-o://e9f6f5780989c7c9282de878d7897d60768178c365759f59e70af6fd618462d0" gracePeriod=30
Jul 29 04:35:14.736480 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.736449    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:14.837428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.837398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:14.847391 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.847364    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"]
Jul 29 04:35:14.851124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.851099    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0c9d218b-qchqh"]
Jul 29 04:35:14.892307 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.892272    2578 generic.go:356] "Generic (PLEG): container finished" podID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" containerID="e9f6f5780989c7c9282de878d7897d60768178c365759f59e70af6fd618462d0" exitCode=0
Jul 29 04:35:14.892474 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.892342    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" event={"ID":"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e","Type":"ContainerDied","Data":"e9f6f5780989c7c9282de878d7897d60768178c365759f59e70af6fd618462d0"}
Jul 29 04:35:14.916228 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.916205    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:35:14.937773 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:14.937684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:15.041854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.041830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca\") pod \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") "
Jul 29 04:35:15.041982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.041888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls\") pod \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") "
Jul 29 04:35:15.041982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.041909    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rtvlx\" (UniqueName: \"kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx\") pod \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\" (UID: \"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e\") "
Jul 29 04:35:15.042187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.042166    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" (UID: "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:15.043961 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.043939    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" (UID: "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:35:15.044109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.044095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx" (OuterVolumeSpecName: "kube-api-access-rtvlx") pod "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" (UID: "5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e"). InnerVolumeSpecName "kube-api-access-rtvlx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:15.143337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.143314    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:15.143337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.143334    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rtvlx\" (UniqueName: \"kubernetes.io/projected/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-kube-api-access-rtvlx\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:15.143471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.143343    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:15.899672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.899631    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb" event={"ID":"5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e","Type":"ContainerDied","Data":"9b649e69d95736cc5038195f8b5b8f1df6217f9c3de19714c52602cba7cd75db"}
Jul 29 04:35:15.899672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.899666    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"
Jul 29 04:35:15.900296 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.899708    2578 scope.go:117] "RemoveContainer" containerID="e9f6f5780989c7c9282de878d7897d60768178c365759f59e70af6fd618462d0"
Jul 29 04:35:15.922561 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.922503    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:35:15.924956 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.924928    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0c9d218b-555c74bf6d-qdrmb"]
Jul 29 04:35:15.947922 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.947881    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:35:15.948145 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.948109    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" containerID="cri-o://493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848" gracePeriod=30
Jul 29 04:35:15.972739 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:15.972701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:16.193828 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.193675    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:16.198301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.198267    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" path="/var/lib/kubelet/pods/3ecdbb71-7af5-4742-8a38-a9f051b5dd1a/volumes"
Jul 29 04:35:16.199131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.199108    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" path="/var/lib/kubelet/pods/5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e/volumes"
Jul 29 04:35:16.405096 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.405061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:16.665099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665070    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:16.665479 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665461    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" containerName="revoke-keys"
Jul 29 04:35:16.665575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665482    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" containerName="revoke-keys"
Jul 29 04:35:16.665575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665500    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" containerName="maas-api"
Jul 29 04:35:16.665575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665508    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" containerName="maas-api"
Jul 29 04:35:16.665741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665603    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5da4e30a-2e0f-4a39-9ab1-dcf45b7fc05e" containerName="maas-api"
Jul 29 04:35:16.665741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665619    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3ecdbb71-7af5-4742-8a38-a9f051b5dd1a" containerName="revoke-keys"
Jul 29 04:35:16.665741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.665630    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4cf0de6f-602e-4b95-91c9-ef8f0fdd86db" containerName="istio-proxy"
Jul 29 04:35:16.668647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.668624    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.671229 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.671210    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-73de3e0f-openshift-default-dockercfg-czqnt\""
Jul 29 04:35:16.683629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.683608    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:16.690436 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.690416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:16.757766 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.757892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.757892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757830    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.757892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.758010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757900    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.758010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.758010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.758010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.757998    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.758159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.758052    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858493 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858462    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858493 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858521    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.858736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.859148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.858971    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.859148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.859121    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.859251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.859157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.859251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.859200    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.859463 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.859438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.861012 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.860989    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.861247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.861218    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.866858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.866839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.866948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.866881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token\") pod \"e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") " pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:16.890155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.890123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:16.978433 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:16.978376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:17.111701 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.111676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:17.112269 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:35:17.112247    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a57d98e_ff37_4c61_b2ea_a27c4927e335.slice/crio-86c20f0fa7181d02ec869240fd985480c35f047d003988ad9628b224ba994faa WatchSource:0}: Error finding container 86c20f0fa7181d02ec869240fd985480c35f047d003988ad9628b224ba994faa: Status 404 returned error can't find the container with id 86c20f0fa7181d02ec869240fd985480c35f047d003988ad9628b224ba994faa
Jul 29 04:35:17.114520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.114482    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:17.114594 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.114576    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:17.114643 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.114627    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:17.913471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.913438    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerStarted","Data":"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"}
Jul 29 04:35:17.913662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.913494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerStarted","Data":"86c20f0fa7181d02ec869240fd985480c35f047d003988ad9628b224ba994faa"}
Jul 29 04:35:17.934780 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.934721    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podStartSLOduration=1.934707067 podStartE2EDuration="1.934707067s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:35:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:35:17.931764373 +0000 UTC m=+1908.206781184" watchObservedRunningTime="2026-07-29 04:35:17.934707067 +0000 UTC m=+1908.209723856"
Jul 29 04:35:17.979342 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:17.979320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:18.873239 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:18.873209    2578 patch_prober.go:28] interesting pod/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 04:35:18.873412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:18.873258    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:35:18.984134 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:18.984109    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:19.259327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.259222    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:19.367560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.367514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:19.374153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.374126    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:19.376914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.376895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.379635 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.379616    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:35:19.379759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.379619    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:35:19.379759 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.379696    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-73de3e0f-serving-cert\""
Jul 29 04:35:19.379909 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.379894    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:35:19.386277 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.386254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:19.459215 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.459183    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:19.480315 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.480289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bhlf\" (UniqueName: \"kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.480449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.480340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.480449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.480414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.581403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.581373    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bhlf\" (UniqueName: \"kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.581526 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.581434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.581526 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.581479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.581660 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:19.581587    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-serving-cert: secret "maas-api-e2e-derive-73de3e0f-serving-cert" not found
Jul 29 04:35:19.581724 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:19.581664    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls podName:e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1 nodeName:}" failed. No retries permitted until 2026-07-29 04:35:20.081639457 +0000 UTC m=+1910.356656224 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls") pod "maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" (UID: "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1") : secret "maas-api-e2e-derive-73de3e0f-serving-cert" not found
Jul 29 04:35:19.582181 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.582157    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.594712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.594690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bhlf\" (UniqueName: \"kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:19.834727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.834643    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:19.926231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.926193    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:19.927046 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.927023    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:19.938367 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:19.938337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:20.021567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.021533    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:20.085923 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.085844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:20.088295 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.088274    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") pod \"maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:20.289085 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.289052    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:20.424890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.424868    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:20.427195 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:35:20.427167    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0a91fa6_1c8c_4958_8ff3_2ebc53765eb1.slice/crio-bcef3a1f23b64238f1f7d65727fde690a9bf3e0f5cfff407747724abc09665ff WatchSource:0}: Error finding container bcef3a1f23b64238f1f7d65727fde690a9bf3e0f5cfff407747724abc09665ff: Status 404 returned error can't find the container with id bcef3a1f23b64238f1f7d65727fde690a9bf3e0f5cfff407747724abc09665ff
Jul 29 04:35:20.429110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.429084    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:35:20.933917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.933884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" event={"ID":"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1","Type":"ContainerStarted","Data":"1c29118d58f9a7ec3c5e43d20d9bdab3719ba0866fa488bf976536aaff8e994a"}
Jul 29 04:35:20.934076 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.933974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" event={"ID":"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1","Type":"ContainerStarted","Data":"bcef3a1f23b64238f1f7d65727fde690a9bf3e0f5cfff407747724abc09665ff"}
Jul 29 04:35:20.950794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:20.950724    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" podStartSLOduration=1.653766762 podStartE2EDuration="1.950709737s" totalImagesPullingTime="296.942975ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:35:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:35:20.949498721 +0000 UTC m=+1911.224515510" watchObservedRunningTime="2026-07-29 04:35:20.950709737 +0000 UTC m=+1911.225726525"
Jul 29 04:35:21.207864 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.207838    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:35:21.298980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.298949    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zp9b\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299000    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299022    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299136 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299040    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299152    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299245    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299289    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299304    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:21.299491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299348    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299371    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:21.299491 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299379    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy\") pod \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\" (UID: \"fcab5e03-3bac-423e-b13b-d6ff7400a13f\") "
Jul 29 04:35:21.299686 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299386    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:21.299686 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299522    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:21.299861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299841    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.299926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299864    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.299926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299877    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.299926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.299889    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.300334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.300312    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data" (OuterVolumeSpecName: "istio-data") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:21.301332 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.301306    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token" (OuterVolumeSpecName: "istio-token") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:21.301436 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.301405    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b" (OuterVolumeSpecName: "kube-api-access-9zp9b") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "kube-api-access-9zp9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:21.301719 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.301691    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:21.301843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.301717    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fcab5e03-3bac-423e-b13b-d6ff7400a13f" (UID: "fcab5e03-3bac-423e-b13b-d6ff7400a13f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:35:21.401302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.401228    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.401302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.401254    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.401302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.401263    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zp9b\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-kube-api-access-9zp9b\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.401302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.401272    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.401302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.401282    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fcab5e03-3bac-423e-b13b-d6ff7400a13f-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:21.940866 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.940834    2578 generic.go:356] "Generic (PLEG): container finished" podID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerID="493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848" exitCode=0
Jul 29 04:35:21.941060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.940884    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"
Jul 29 04:35:21.941060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.940919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerDied","Data":"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"}
Jul 29 04:35:21.941060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.940977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5" event={"ID":"fcab5e03-3bac-423e-b13b-d6ff7400a13f","Type":"ContainerDied","Data":"049d1bcb0ae6ffe972f43ef5d67f0e944bbf46d4480e64b1b0f4d104fa4b72ce"}
Jul 29 04:35:21.941060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.941007    2578 scope.go:117] "RemoveContainer" containerID="493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"
Jul 29 04:35:21.941381 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.941352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:21.951184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.951168    2578 scope.go:117] "RemoveContainer" containerID="c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"
Jul 29 04:35:21.959116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.959100    2578 scope.go:117] "RemoveContainer" containerID="493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"
Jul 29 04:35:21.959350 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:21.959329    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848\": container with ID starting with 493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848 not found: ID does not exist" containerID="493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"
Jul 29 04:35:21.959447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.959356    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848"} err="failed to get container status \"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848\": rpc error: code = NotFound desc = could not find container \"493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848\": container with ID starting with 493df3077b3538fa83ebf2ca7a848da441b5e1e87d904f7b75355cddcabfa848 not found: ID does not exist"
Jul 29 04:35:21.959447 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.959374    2578 scope.go:117] "RemoveContainer" containerID="c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"
Jul 29 04:35:21.959621 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:21.959604    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90\": container with ID starting with c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90 not found: ID does not exist" containerID="c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"
Jul 29 04:35:21.959666 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.959627    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90"} err="failed to get container status \"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90\": rpc error: code = NotFound desc = could not find container \"c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90\": container with ID starting with c795eeb59945f20ccff18726d5146eccd10248a72cef6fdb234d34f689b84d90 not found: ID does not exist"
Jul 29 04:35:21.965379 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.965357    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:35:21.970178 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:21.970159    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0c9d218b-openshift-default-79bc84cd66-7c9f5"]
Jul 29 04:35:22.195498 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:22.195412    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" path="/var/lib/kubelet/pods/fcab5e03-3bac-423e-b13b-d6ff7400a13f/volumes"
Jul 29 04:35:27.954835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:27.954807    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:31.997567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.997490    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerID="91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf" exitCode=0
Jul 29 04:35:31.997567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.997550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerDied","Data":"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"}
Jul 29 04:35:31.998025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.998006    2578 scope.go:117] "RemoveContainer" containerID="91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"
Jul 29 04:35:31.999082 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.999049    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:31.999160 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.999129    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:31.999201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:31.999175    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:35:33.004859 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:33.004820    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerStarted","Data":"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"}
Jul 29 04:35:33.978702 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:33.978663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:33.979910 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:33.979879    2578 patch_prober.go:28] interesting pod/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 04:35:33.980028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:33.979931    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 04:35:34.926782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:34.926724    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:34.978783 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:34.978722    2578 patch_prober.go:28] interesting pod/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 04:35:34.978949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:34.978802    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 04:35:35.979487 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:35.979453    2578 patch_prober.go:28] interesting pod/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Jul 29 04:35:35.979896 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:35.979517    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Jul 29 04:35:36.889887 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:36.889848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:36.983215 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:36.983189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:36.984059 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:36.984041    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:44.136828 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.136795    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"]
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137162    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137175    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137201    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137207    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137270    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.137302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.137280    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fcab5e03-3bac-423e-b13b-d6ff7400a13f" containerName="istio-proxy"
Jul 29 04:35:44.139179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.139163    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:44.141585 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.141562    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:35:44.147103 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.147082    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"]
Jul 29 04:35:44.209520 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.209492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw\" (UID: \"6f7400e2-7667-4073-8279-560d1297f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:44.310444 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.310409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw\" (UID: \"6f7400e2-7667-4073-8279-560d1297f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:44.311098 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.311079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw\" (UID: \"6f7400e2-7667-4073-8279-560d1297f46f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:44.451362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.451297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:44.577423 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:44.577394    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"]
Jul 29 04:35:44.578981 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:35:44.578956    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f7400e2_7667_4073_8279_560d1297f46f.slice/crio-ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68 WatchSource:0}: Error finding container ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68: Status 404 returned error can't find the container with id ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68
Jul 29 04:35:45.073854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:45.073822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw" event={"ID":"6f7400e2-7667-4073-8279-560d1297f46f","Type":"ContainerStarted","Data":"9dbded59a2c20e522273890b6a39c7ba4f6375cd81c744190de5f4a21f267b0f"}
Jul 29 04:35:45.074002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:45.073904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw" event={"ID":"6f7400e2-7667-4073-8279-560d1297f46f","Type":"ContainerStarted","Data":"ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68"}
Jul 29 04:35:45.089706 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:45.089652    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw" podStartSLOduration=1.08963941 podStartE2EDuration="1.08963941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:35:45.087905992 +0000 UTC m=+1935.362922784" watchObservedRunningTime="2026-07-29 04:35:45.08963941 +0000 UTC m=+1935.364656198"
Jul 29 04:35:46.080962 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:46.080929    2578 generic.go:356] "Generic (PLEG): container finished" podID="6f7400e2-7667-4073-8279-560d1297f46f" containerID="9dbded59a2c20e522273890b6a39c7ba4f6375cd81c744190de5f4a21f267b0f" exitCode=0
Jul 29 04:35:46.081389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:46.081018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw" event={"ID":"6f7400e2-7667-4073-8279-560d1297f46f","Type":"ContainerDied","Data":"9dbded59a2c20e522273890b6a39c7ba4f6375cd81c744190de5f4a21f267b0f"}
Jul 29 04:35:47.217414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:47.217390    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:47.230261 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:47.230240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca\") pod \"6f7400e2-7667-4073-8279-560d1297f46f\" (UID: \"6f7400e2-7667-4073-8279-560d1297f46f\") "
Jul 29 04:35:47.230619 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:47.230592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6f7400e2-7667-4073-8279-560d1297f46f" (UID: "6f7400e2-7667-4073-8279-560d1297f46f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:47.331205 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:47.331174    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6f7400e2-7667-4073-8279-560d1297f46f-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:48.093036 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:48.093010    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"
Jul 29 04:35:48.093207 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:48.093004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw" event={"ID":"6f7400e2-7667-4073-8279-560d1297f46f","Type":"ContainerDied","Data":"ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68"}
Jul 29 04:35:48.093207 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:48.093142    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab11d89e786d78048499d4214ca50d419fc29b39274f6f7c55ac724cc7232c68"
Jul 29 04:35:49.967733 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:49.967683    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:49.968830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:49.968531    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" podUID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" containerName="maas-api" containerID="cri-o://1c29118d58f9a7ec3c5e43d20d9bdab3719ba0866fa488bf976536aaff8e994a" gracePeriod=30
Jul 29 04:35:49.991197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:49.991174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:50.107340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.107311    2578 generic.go:356] "Generic (PLEG): container finished" podID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" containerID="1c29118d58f9a7ec3c5e43d20d9bdab3719ba0866fa488bf976536aaff8e994a" exitCode=0
Jul 29 04:35:50.107500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.107391    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" event={"ID":"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1","Type":"ContainerDied","Data":"1c29118d58f9a7ec3c5e43d20d9bdab3719ba0866fa488bf976536aaff8e994a"}
Jul 29 04:35:50.131084 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.131050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:50.136667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.136634    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"]
Jul 29 04:35:50.139082 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.139059    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-73de3e0f-jwlgw"]
Jul 29 04:35:50.190433 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.190370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:50.205364 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.205328    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f7400e2-7667-4073-8279-560d1297f46f" path="/var/lib/kubelet/pods/6f7400e2-7667-4073-8279-560d1297f46f/volumes"
Jul 29 04:35:50.231825 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.231803    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:50.252487 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.252444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4bhlf\" (UniqueName: \"kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf\") pod \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") "
Jul 29 04:35:50.252645 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.252516    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") pod \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") "
Jul 29 04:35:50.252645 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.252587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca\") pod \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\" (UID: \"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1\") "
Jul 29 04:35:50.254010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.253949    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" (UID: "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:50.257002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.256967    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf" (OuterVolumeSpecName: "kube-api-access-4bhlf") pod "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" (UID: "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1"). InnerVolumeSpecName "kube-api-access-4bhlf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:50.257162 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.257137    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" (UID: "e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:35:50.276058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.276023    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:50.276330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.276301    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy" containerID="cri-o://5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c" gracePeriod=30
Jul 29 04:35:50.324399 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.324367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:50.354458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.354429    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:50.354458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.354454    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4bhlf\" (UniqueName: \"kubernetes.io/projected/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-kube-api-access-4bhlf\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:50.354617 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.354465    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:50.682637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.682605    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:50.957474 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:50.957376    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:51.113430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.113403    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"
Jul 29 04:35:51.113917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.113444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw" event={"ID":"e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1","Type":"ContainerDied","Data":"bcef3a1f23b64238f1f7d65727fde690a9bf3e0f5cfff407747724abc09665ff"}
Jul 29 04:35:51.113917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.113502    2578 scope.go:117] "RemoveContainer" containerID="1c29118d58f9a7ec3c5e43d20d9bdab3719ba0866fa488bf976536aaff8e994a"
Jul 29 04:35:51.135782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.135734    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:51.141678 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.141658    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-73de3e0f-858cc785f9-5pqhw"]
Jul 29 04:35:51.182991 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.182970    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:51.285056 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.285032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:35:51.986660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.986617    2578 patch_prober.go:28] interesting pod/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused
Jul 29 04:35:51.986881 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:51.986677    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:35:52.194535 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:52.194495    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" path="/var/lib/kubelet/pods/e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1/volumes"
Jul 29 04:35:55.534548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.534526    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:55.599245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599220    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599247    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599276    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599306    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599325    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599347    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599369    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599504 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy\") pod \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\" (UID: \"3a57d98e-ff37-4c61-b2ea-a27c4927e335\") "
Jul 29 04:35:55.599860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599553    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:55.599860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599671    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.599860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599701    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:35:55.599989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:55.599989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.599906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:55.600207 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.600183    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:55.601603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.601577    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:35:55.601603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.601592    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:35:55.601884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.601858    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:55.601980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.601884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p" (OuterVolumeSpecName: "kube-api-access-c7m7p") pod "3a57d98e-ff37-4c61-b2ea-a27c4927e335" (UID: "3a57d98e-ff37-4c61-b2ea-a27c4927e335"). InnerVolumeSpecName "kube-api-access-c7m7p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:35:55.700297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700268    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7m7p\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-kube-api-access-c7m7p\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700293    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700297 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700305    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700313    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700321    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700328    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700336    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:55.700525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:55.700344    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a57d98e-ff37-4c61-b2ea-a27c4927e335-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:35:56.142366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.142335    2578 generic.go:356] "Generic (PLEG): container finished" podID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerID="5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c" exitCode=0
Jul 29 04:35:56.142542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.142382    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"
Jul 29 04:35:56.142542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.142424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerDied","Data":"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"}
Jul 29 04:35:56.142542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.142506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7" event={"ID":"3a57d98e-ff37-4c61-b2ea-a27c4927e335","Type":"ContainerDied","Data":"86c20f0fa7181d02ec869240fd985480c35f047d003988ad9628b224ba994faa"}
Jul 29 04:35:56.142542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.142529    2578 scope.go:117] "RemoveContainer" containerID="5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"
Jul 29 04:35:56.152325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.152310    2578 scope.go:117] "RemoveContainer" containerID="91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"
Jul 29 04:35:56.160596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.160576    2578 scope.go:117] "RemoveContainer" containerID="5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"
Jul 29 04:35:56.160930 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:56.160909    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c\": container with ID starting with 5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c not found: ID does not exist" containerID="5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"
Jul 29 04:35:56.161009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.160943    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c"} err="failed to get container status \"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c\": rpc error: code = NotFound desc = could not find container \"5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c\": container with ID starting with 5cc044f3ef31aecf0fb9853314064cdd981c23f4dcdcb7d24bfac9b66adba22c not found: ID does not exist"
Jul 29 04:35:56.161009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.160966    2578 scope.go:117] "RemoveContainer" containerID="91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"
Jul 29 04:35:56.161210 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:35:56.161191    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf\": container with ID starting with 91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf not found: ID does not exist" containerID="91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"
Jul 29 04:35:56.161252 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.161216    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf"} err="failed to get container status \"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf\": rpc error: code = NotFound desc = could not find container \"91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf\": container with ID starting with 91c55aafea92e701acd6159a4806e0755159e0d87cd60613019d5f04d217fbbf not found: ID does not exist"
Jul 29 04:35:56.168115 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.168094    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:56.172618 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.172592    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-73de3e0f-openshift-default-6b66597656-qrdq7"]
Jul 29 04:35:56.195047 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:35:56.195023    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" path="/var/lib/kubelet/pods/3a57d98e-ff37-4c61-b2ea-a27c4927e335/volumes"
Jul 29 04:36:12.986940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:12.986897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:19.177143 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:19.177094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:19.279180 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:19.279146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:19.384126 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:19.384093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:19.476465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:19.476386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:19.858982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:19.858952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:45.801838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:45.801801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:52.170836 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:52.170799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:52.267843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:52.267811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:36:52.367889 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:36:52.367845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:08.255420 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:08.255378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:14.106898 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:14.106860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:14.172208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:14.172162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:14.239425 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:14.239386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:14.340028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:14.339993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:24.816739 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:24.816701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:35.832329 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:35.832292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:40.471774 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:40.471717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:40.579866 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:40.579829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:42.379549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:42.379515    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:42.496625 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:42.496587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:42.580089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:42.580054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:37:42.680024 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:37:42.679930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:38:30.277069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:38:30.277042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:38:30.280056 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:38:30.280028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:39:44.406883 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:44.406846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:50.857133 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:50.857104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:50.926240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:50.926202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:51.557114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.557080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:51.834015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.833935    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:39:51.834283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834264    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:51.834283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834281    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834296    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f7400e2-7667-4073-8279-560d1297f46f" containerName="revoke-keys"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834302    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f7400e2-7667-4073-8279-560d1297f46f" containerName="revoke-keys"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834321    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" containerName="maas-api"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834327    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" containerName="maas-api"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834377    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834384    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0a91fa6-1c8c-4958-8ff3-2ebc53765eb1" containerName="maas-api"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834392    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:51.834443 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.834398    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f7400e2-7667-4073-8279-560d1297f46f" containerName="revoke-keys"
Jul 29 04:39:51.837458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.837441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.839835 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.839802    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ebe3d1f6-openshift-default-dockercfg-zfcb7\""
Jul 29 04:39:51.862328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.862309    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:39:51.865183 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.865153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:51.932727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.932862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.932862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.932862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.932862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932846    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.933002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932870    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.933002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.933002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932960    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm4nc\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:51.933002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:51.932983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm4nc\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034606 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034606 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034606 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034614    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034639    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.034967 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.034949    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.035111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.035083    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.035242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.035068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.035242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.035183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.035372 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.035293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.036701 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.036678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.037050 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.037034    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.041795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.041775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.042116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.042095    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm4nc\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc\") pod \"e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") " pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.148171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.148088    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:52.285346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.285317    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:39:52.286672 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:39:52.286645    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb2b1469_6d22_4fe6_a459_c332e48971a0.slice/crio-d88fd04e4ee11de0fe3cc1637d75c3e07b94ae22b6457847adf8b90dd6412f61 WatchSource:0}: Error finding container d88fd04e4ee11de0fe3cc1637d75c3e07b94ae22b6457847adf8b90dd6412f61: Status 404 returned error can't find the container with id d88fd04e4ee11de0fe3cc1637d75c3e07b94ae22b6457847adf8b90dd6412f61
Jul 29 04:39:52.289122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.289091    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:39:52.289184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.289152    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:39:52.289231 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.289182    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:39:52.372219 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.372182    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerStarted","Data":"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"}
Jul 29 04:39:52.372325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.372231    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerStarted","Data":"d88fd04e4ee11de0fe3cc1637d75c3e07b94ae22b6457847adf8b90dd6412f61"}
Jul 29 04:39:52.397424 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.397364    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podStartSLOduration=1.397343825 podStartE2EDuration="1.397343825s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:39:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:39:52.393220062 +0000 UTC m=+2182.668236850" watchObservedRunningTime="2026-07-29 04:39:52.397343825 +0000 UTC m=+2182.672360614"
Jul 29 04:39:52.604842 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:52.604813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:53.148521 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:53.148486    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:53.153185 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:53.153159    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:53.377584 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:53.377552    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:53.378411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:53.378393    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:39:54.571843 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.571807    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:54.660724 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.660692    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:54.789614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.789586    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:39:54.789947 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.789933    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:54.790004 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.789949    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a57d98e-ff37-4c61-b2ea-a27c4927e335" containerName="istio-proxy"
Jul 29 04:39:54.793093 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.793075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.795651 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.795622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-ebe3d1f6-serving-cert\""
Jul 29 04:39:54.795811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.795794    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:39:54.797174 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.797155    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:39:54.797272 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.797227    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:39:54.803473 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.803454    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:39:54.818290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.818265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:54.857695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.857634    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mqxsq\" (UniqueName: \"kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.857817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.857692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.857817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.857799    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.958387 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.958355    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mqxsq\" (UniqueName: \"kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.958534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.958406    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.958534 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.958441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.958617 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:39:54.958565    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-serving-cert: secret "maas-api-e2e-mt-ebe3d1f6-serving-cert" not found
Jul 29 04:39:54.958653 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:39:54.958637    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls podName:fe534b61-1c8b-49b8-974c-bc37a39928ef nodeName:}" failed. No retries permitted until 2026-07-29 04:39:55.458621881 +0000 UTC m=+2185.733638648 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls") pod "maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" (UID: "fe534b61-1c8b-49b8-974c-bc37a39928ef") : secret "maas-api-e2e-mt-ebe3d1f6-serving-cert" not found
Jul 29 04:39:54.959122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.959104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:54.969595 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:54.969571    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mqxsq\" (UniqueName: \"kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:55.171779 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.171685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:55.462354 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.462279    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:55.464704 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.464678    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") pod \"maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:55.543921 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.543889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:55.646074 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.646040    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:39:55.704682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.704653    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:55.829978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.829947    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:39:55.833639 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.833617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:55.836087 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.836064    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-ebe3d1f6\""
Jul 29 04:39:55.836201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.836068    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-ebe3d1f6-dockercfg-t8v8t\""
Jul 29 04:39:55.844820 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.844795    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:39:55.860037 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:39:55.860010    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe534b61_1c8b_49b8_974c_bc37a39928ef.slice/crio-a4804bec49d6d4227972b76bb57025647dff0e0490b39e8895eaa5a2430b75de WatchSource:0}: Error finding container a4804bec49d6d4227972b76bb57025647dff0e0490b39e8895eaa5a2430b75de: Status 404 returned error can't find the container with id a4804bec49d6d4227972b76bb57025647dff0e0490b39e8895eaa5a2430b75de
Jul 29 04:39:55.861086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.861065    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:39:55.966969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.966898    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:55.967079 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:55.966970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48k7f\" (UniqueName: \"kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.067415 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.067387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.067539 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.067437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48k7f\" (UniqueName: \"kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.068350 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.068328    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.078647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.078619    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-48k7f\" (UniqueName: \"kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f\") pod \"payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") " pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.146458 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.146433    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:56.395412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.395384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" event={"ID":"fe534b61-1c8b-49b8-974c-bc37a39928ef","Type":"ContainerStarted","Data":"a4804bec49d6d4227972b76bb57025647dff0e0490b39e8895eaa5a2430b75de"}
Jul 29 04:39:56.482223 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:56.482197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:39:56.483015 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:39:56.482992    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac0dcb9c_d517_452b_977a_391090f0408c.slice/crio-d3eac975f919c0ddbb1982c94dce057e651ef13a5169ab7696d4a641c6cae215 WatchSource:0}: Error finding container d3eac975f919c0ddbb1982c94dce057e651ef13a5169ab7696d4a641c6cae215: Status 404 returned error can't find the container with id d3eac975f919c0ddbb1982c94dce057e651ef13a5169ab7696d4a641c6cae215
Jul 29 04:39:57.402453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.402407    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" event={"ID":"fe534b61-1c8b-49b8-974c-bc37a39928ef","Type":"ContainerStarted","Data":"e19fbb4e5944ffe21ab7662dfdbdd428fcf3380b06f16d640ab902e08f46821a"}
Jul 29 04:39:57.402901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.402482    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:39:57.403899 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.403870    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" event={"ID":"ac0dcb9c-d517-452b-977a-391090f0408c","Type":"ContainerStarted","Data":"ce79e98f53c54d9b916b1b6e9372caff45e038ad0469811e78f72136c7a66c23"}
Jul 29 04:39:57.404039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.403921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" event={"ID":"ac0dcb9c-d517-452b-977a-391090f0408c","Type":"ContainerStarted","Data":"d3eac975f919c0ddbb1982c94dce057e651ef13a5169ab7696d4a641c6cae215"}
Jul 29 04:39:57.404039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.403942    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:39:57.419553 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.419504    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" podStartSLOduration=2.902062462 podStartE2EDuration="3.419491192s" totalImagesPullingTime="517.42873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:39:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:39:57.417210773 +0000 UTC m=+2187.692227556" watchObservedRunningTime="2026-07-29 04:39:57.419491192 +0000 UTC m=+2187.694507979"
Jul 29 04:39:57.432781 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:39:57.432723    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" podStartSLOduration=2.432711353 podStartE2EDuration="2.432711353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:39:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:39:57.431240399 +0000 UTC m=+2187.706257188" watchObservedRunningTime="2026-07-29 04:39:57.432711353 +0000 UTC m=+2187.707728141"
Jul 29 04:40:03.415058 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:03.414964    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:40:06.456428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.456394    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerID="49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2" exitCode=0
Jul 29 04:40:06.456976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.456450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerDied","Data":"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"}
Jul 29 04:40:06.456976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.456949    2578 scope.go:117] "RemoveContainer" containerID="49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"
Jul 29 04:40:06.458022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.457987    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:40:06.458124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.458057    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:40:06.458124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:06.458089    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:40:07.467043 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:07.467003    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerStarted","Data":"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"}
Jul 29 04:40:08.148791 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:08.148734    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:08.150177 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:08.150141    2578 patch_prober.go:28] interesting pod/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 29 04:40:08.150323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:08.150208    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 29 04:40:08.377927 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:08.377898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:08.411804 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:08.411713    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:40:09.149509 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:09.149089    2578 patch_prober.go:28] interesting pod/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 29 04:40:09.149509 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:09.149150    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 29 04:40:10.149040 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:10.148999    2578 patch_prober.go:28] interesting pod/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 29 04:40:10.149254 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:10.149070    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 29 04:40:11.148892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:11.148845    2578 patch_prober.go:28] interesting pod/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Jul 29 04:40:11.149358 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:11.148906    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Jul 29 04:40:12.153071 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:12.153038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:12.154160 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:12.154143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:19.578099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:19.578059    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:20.197741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:20.197694    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:20.297017 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:20.296986    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:20.604474 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:20.604444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:26.379501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.379456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:26.479737 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.479709    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:26.727214 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.727142    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"]
Jul 29 04:40:26.729500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.729483    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:26.731930 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.731910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:40:26.737576 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.737553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"]
Jul 29 04:40:26.824789 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.824736    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4\" (UID: \"f3c42a0e-5870-41c2-8034-d3bb9ccebf72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:26.925446 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.925419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4\" (UID: \"f3c42a0e-5870-41c2-8034-d3bb9ccebf72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:26.926060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:26.926042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4\" (UID: \"f3c42a0e-5870-41c2-8034-d3bb9ccebf72\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:27.041184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:27.041162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:27.168068 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:27.168038    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"]
Jul 29 04:40:27.169486 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:40:27.169462    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3c42a0e_5870_41c2_8034_d3bb9ccebf72.slice/crio-3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186 WatchSource:0}: Error finding container 3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186: Status 404 returned error can't find the container with id 3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186
Jul 29 04:40:27.583305 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:27.583271    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4" event={"ID":"f3c42a0e-5870-41c2-8034-d3bb9ccebf72","Type":"ContainerStarted","Data":"43ba3aa7ed22e17157af266b895b11fa7e39320a1503419a0417fb08f30b9f6f"}
Jul 29 04:40:27.583720 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:27.583326    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4" event={"ID":"f3c42a0e-5870-41c2-8034-d3bb9ccebf72","Type":"ContainerStarted","Data":"3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186"}
Jul 29 04:40:27.597151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:27.597058    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4" podStartSLOduration=1.597040277 podStartE2EDuration="1.597040277s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:40:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:40:27.596470205 +0000 UTC m=+2217.871486995" watchObservedRunningTime="2026-07-29 04:40:27.597040277 +0000 UTC m=+2217.872057065"
Jul 29 04:40:28.590378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:28.590345    2578 generic.go:356] "Generic (PLEG): container finished" podID="f3c42a0e-5870-41c2-8034-d3bb9ccebf72" containerID="43ba3aa7ed22e17157af266b895b11fa7e39320a1503419a0417fb08f30b9f6f" exitCode=0
Jul 29 04:40:28.590794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:28.590431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4" event={"ID":"f3c42a0e-5870-41c2-8034-d3bb9ccebf72","Type":"ContainerDied","Data":"43ba3aa7ed22e17157af266b895b11fa7e39320a1503419a0417fb08f30b9f6f"}
Jul 29 04:40:29.721037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:29.721011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:29.748133 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:29.748105    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca\") pod \"f3c42a0e-5870-41c2-8034-d3bb9ccebf72\" (UID: \"f3c42a0e-5870-41c2-8034-d3bb9ccebf72\") "
Jul 29 04:40:29.748486 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:29.748459    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f3c42a0e-5870-41c2-8034-d3bb9ccebf72" (UID: "f3c42a0e-5870-41c2-8034-d3bb9ccebf72"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:40:29.849492 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:29.849431    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3c42a0e-5870-41c2-8034-d3bb9ccebf72-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:30.601740 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:30.601711    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"
Jul 29 04:40:30.601951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:30.601774    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4" event={"ID":"f3c42a0e-5870-41c2-8034-d3bb9ccebf72","Type":"ContainerDied","Data":"3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186"}
Jul 29 04:40:30.601951 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:30.601846    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3683424fc07688c81e91690a656610e618d0f8c125e8b445f91f3fb7dee78186"
Jul 29 04:40:37.403383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.403348    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:40:37.403845 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.403589    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" podUID="fe534b61-1c8b-49b8-974c-bc37a39928ef" containerName="maas-api" containerID="cri-o://e19fbb4e5944ffe21ab7662dfdbdd428fcf3380b06f16d640ab902e08f46821a" gracePeriod=30
Jul 29 04:40:37.438931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.438909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:37.466011 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.465985    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:40:37.466446 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.466281    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" podUID="ac0dcb9c-d517-452b-977a-391090f0408c" containerName="payload-processing" containerID="cri-o://ce79e98f53c54d9b916b1b6e9372caff45e038ad0469811e78f72136c7a66c23" gracePeriod=30
Jul 29 04:40:37.535045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.535003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:37.597072 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.597045    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"]
Jul 29 04:40:37.599774 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.599736    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-ebe3d1f6-5tpj4"]
Jul 29 04:40:37.603180 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.603152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:37.644988 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.644956    2578 generic.go:356] "Generic (PLEG): container finished" podID="fe534b61-1c8b-49b8-974c-bc37a39928ef" containerID="e19fbb4e5944ffe21ab7662dfdbdd428fcf3380b06f16d640ab902e08f46821a" exitCode=0
Jul 29 04:40:37.645122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.645107    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" event={"ID":"fe534b61-1c8b-49b8-974c-bc37a39928ef","Type":"ContainerDied","Data":"e19fbb4e5944ffe21ab7662dfdbdd428fcf3380b06f16d640ab902e08f46821a"}
Jul 29 04:40:37.646954 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.646932    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac0dcb9c-d517-452b-977a-391090f0408c" containerID="ce79e98f53c54d9b916b1b6e9372caff45e038ad0469811e78f72136c7a66c23" exitCode=0
Jul 29 04:40:37.647148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.646961    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" event={"ID":"ac0dcb9c-d517-452b-977a-391090f0408c","Type":"ContainerDied","Data":"ce79e98f53c54d9b916b1b6e9372caff45e038ad0469811e78f72136c7a66c23"}
Jul 29 04:40:37.676433 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.676344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:37.725137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.725114    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:40:37.738224 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.738206    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:40:37.820695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.820668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mqxsq\" (UniqueName: \"kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq\") pod \"fe534b61-1c8b-49b8-974c-bc37a39928ef\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") "
Jul 29 04:40:37.820840 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.820727    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca\") pod \"fe534b61-1c8b-49b8-974c-bc37a39928ef\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") "
Jul 29 04:40:37.820840 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.820816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume\") pod \"ac0dcb9c-d517-452b-977a-391090f0408c\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") "
Jul 29 04:40:37.820961 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.820864    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") pod \"fe534b61-1c8b-49b8-974c-bc37a39928ef\" (UID: \"fe534b61-1c8b-49b8-974c-bc37a39928ef\") "
Jul 29 04:40:37.820961 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.820900    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48k7f\" (UniqueName: \"kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f\") pod \"ac0dcb9c-d517-452b-977a-391090f0408c\" (UID: \"ac0dcb9c-d517-452b-977a-391090f0408c\") "
Jul 29 04:40:37.821076 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.821018    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fe534b61-1c8b-49b8-974c-bc37a39928ef" (UID: "fe534b61-1c8b-49b8-974c-bc37a39928ef"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:40:37.821217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.821195    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ac0dcb9c-d517-452b-977a-391090f0408c" (UID: "ac0dcb9c-d517-452b-977a-391090f0408c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:40:37.822903 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.822872    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq" (OuterVolumeSpecName: "kube-api-access-mqxsq") pod "fe534b61-1c8b-49b8-974c-bc37a39928ef" (UID: "fe534b61-1c8b-49b8-974c-bc37a39928ef"). InnerVolumeSpecName "kube-api-access-mqxsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:40:37.822987 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.822883    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fe534b61-1c8b-49b8-974c-bc37a39928ef" (UID: "fe534b61-1c8b-49b8-974c-bc37a39928ef"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:40:37.822987 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.822905    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f" (OuterVolumeSpecName: "kube-api-access-48k7f") pod "ac0dcb9c-d517-452b-977a-391090f0408c" (UID: "ac0dcb9c-d517-452b-977a-391090f0408c"). InnerVolumeSpecName "kube-api-access-48k7f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:40:37.922271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.922217    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ac0dcb9c-d517-452b-977a-391090f0408c-plugins-config-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:37.922271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.922236    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fe534b61-1c8b-49b8-974c-bc37a39928ef-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:37.922271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.922246    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48k7f\" (UniqueName: \"kubernetes.io/projected/ac0dcb9c-d517-452b-977a-391090f0408c-kube-api-access-48k7f\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:37.922271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.922255    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mqxsq\" (UniqueName: \"kubernetes.io/projected/fe534b61-1c8b-49b8-974c-bc37a39928ef-kube-api-access-mqxsq\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:37.922271 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.922264    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fe534b61-1c8b-49b8-974c-bc37a39928ef-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:37.978199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:37.978172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:38.195668 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.195600    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3c42a0e-5870-41c2-8034-d3bb9ccebf72" path="/var/lib/kubelet/pods/f3c42a0e-5870-41c2-8034-d3bb9ccebf72/volumes"
Jul 29 04:40:38.653551 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.653525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"
Jul 29 04:40:38.653980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.653563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr" event={"ID":"ac0dcb9c-d517-452b-977a-391090f0408c","Type":"ContainerDied","Data":"d3eac975f919c0ddbb1982c94dce057e651ef13a5169ab7696d4a641c6cae215"}
Jul 29 04:40:38.653980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.653615    2578 scope.go:117] "RemoveContainer" containerID="ce79e98f53c54d9b916b1b6e9372caff45e038ad0469811e78f72136c7a66c23"
Jul 29 04:40:38.655099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.655072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk" event={"ID":"fe534b61-1c8b-49b8-974c-bc37a39928ef","Type":"ContainerDied","Data":"a4804bec49d6d4227972b76bb57025647dff0e0490b39e8895eaa5a2430b75de"}
Jul 29 04:40:38.655099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.655091    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"
Jul 29 04:40:38.662485 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.662457    2578 scope.go:117] "RemoveContainer" containerID="e19fbb4e5944ffe21ab7662dfdbdd428fcf3380b06f16d640ab902e08f46821a"
Jul 29 04:40:38.674633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.674612    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:40:38.678034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.678014    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-ebe3d1f6-7fc954dcc8-kvvbk"]
Jul 29 04:40:38.690316 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.690297    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:40:38.695023 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:38.695005    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-ebe3d1f6-5fb99668c4-6xcpr"]
Jul 29 04:40:40.195649 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:40.195613    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac0dcb9c-d517-452b-977a-391090f0408c" path="/var/lib/kubelet/pods/ac0dcb9c-d517-452b-977a-391090f0408c/volumes"
Jul 29 04:40:40.196045 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:40.196005    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe534b61-1c8b-49b8-974c-bc37a39928ef" path="/var/lib/kubelet/pods/fe534b61-1c8b-49b8-974c-bc37a39928ef/volumes"
Jul 29 04:40:43.680288 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:43.680258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:43.738902 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:43.738877    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:43.916515 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:43.916482    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:40:43.916722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:43.916700    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy" containerID="cri-o://5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683" gracePeriod=30
Jul 29 04:40:43.937468 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:43.937402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:44.157446 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:44.157401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:44.292371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:44.292340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:44.390318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:44.390292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:44.539565 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:44.539512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:49.166825 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.166802    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:49.214063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214005    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214234 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214234 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214143    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214234 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214234 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214262    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214298    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wm4nc\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214326    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket\") pod \"eb2b1469-6d22-4fe6-a459-c332e48971a0\" (UID: \"eb2b1469-6d22-4fe6-a459-c332e48971a0\") "
Jul 29 04:40:49.214453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214338    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:40:49.214453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:40:49.214728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214622    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.214728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214641    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.214728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214642    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:40:49.214728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.214688    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:40:49.215112 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.215080    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data" (OuterVolumeSpecName: "istio-data") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:40:49.216390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.216347    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:40:49.216390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.216372    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:40:49.216538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.216390    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token" (OuterVolumeSpecName: "istio-token") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:40:49.216620 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.216601    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc" (OuterVolumeSpecName: "kube-api-access-wm4nc") pod "eb2b1469-6d22-4fe6-a459-c332e48971a0" (UID: "eb2b1469-6d22-4fe6-a459-c332e48971a0"). InnerVolumeSpecName "kube-api-access-wm4nc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:40:49.315721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315694    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315721    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315735    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/eb2b1469-6d22-4fe6-a459-c332e48971a0-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315772    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wm4nc\" (UniqueName: \"kubernetes.io/projected/eb2b1469-6d22-4fe6-a459-c332e48971a0-kube-api-access-wm4nc\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315789    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315804    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.315913 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.315817    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/eb2b1469-6d22-4fe6-a459-c332e48971a0-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:40:49.716944 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.716907    2578 generic.go:356] "Generic (PLEG): container finished" podID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerID="5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683" exitCode=0
Jul 29 04:40:49.717139 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.716961    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"
Jul 29 04:40:49.717139 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.716999    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerDied","Data":"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"}
Jul 29 04:40:49.717139 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.717069    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl" event={"ID":"eb2b1469-6d22-4fe6-a459-c332e48971a0","Type":"ContainerDied","Data":"d88fd04e4ee11de0fe3cc1637d75c3e07b94ae22b6457847adf8b90dd6412f61"}
Jul 29 04:40:49.717139 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.717100    2578 scope.go:117] "RemoveContainer" containerID="5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"
Jul 29 04:40:49.726855 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.726836    2578 scope.go:117] "RemoveContainer" containerID="49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"
Jul 29 04:40:49.735247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.735232    2578 scope.go:117] "RemoveContainer" containerID="5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"
Jul 29 04:40:49.735535 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:40:49.735512    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683\": container with ID starting with 5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683 not found: ID does not exist" containerID="5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"
Jul 29 04:40:49.735654 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.735541    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683"} err="failed to get container status \"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683\": rpc error: code = NotFound desc = could not find container \"5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683\": container with ID starting with 5c84505695b4921c4e5b734098b6261e54835b03778c3c6076861f4353740683 not found: ID does not exist"
Jul 29 04:40:49.735654 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.735564    2578 scope.go:117] "RemoveContainer" containerID="49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"
Jul 29 04:40:49.735858 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:40:49.735833    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2\": container with ID starting with 49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2 not found: ID does not exist" containerID="49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"
Jul 29 04:40:49.735914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.735868    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2"} err="failed to get container status \"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2\": rpc error: code = NotFound desc = could not find container \"49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2\": container with ID starting with 49c98ab834ae61c11e7f9e83410ef43503acc8df8566b0b013f7f5568e8bdbc2 not found: ID does not exist"
Jul 29 04:40:49.739118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.739099    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:40:49.745393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:49.745370    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ebe3d1f6-openshift-default-5c4ccf75b8-wjbkl"]
Jul 29 04:40:50.200945 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:50.200914    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" path="/var/lib/kubelet/pods/eb2b1469-6d22-4fe6-a459-c332e48971a0/volumes"
Jul 29 04:40:50.373703 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:50.373678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:50.475545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:50.475482    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:50.572079 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:50.572051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:50.768965 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:50.768938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:56.329103 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:56.329030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:40:56.442465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:40:56.442436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:41:30.378884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:41:30.378844    2578 scope.go:117] "RemoveContainer" containerID="4e5fc7fe53580f98b35e9a35c41f3d3e4aa52dd8c574737a77cade06ce872886"
Jul 29 04:41:30.388684 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:41:30.388666    2578 scope.go:117] "RemoveContainer" containerID="a125282e34d012d21aa9e75c731fe630c1ff7bad09722d61d6712153431fdad5"
Jul 29 04:42:00.534254 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:42:00.534217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:42:00.702243 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:42:00.702211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:42:30.423446 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:42:30.423416    2578 scope.go:117] "RemoveContainer" containerID="9dbded59a2c20e522273890b6a39c7ba4f6375cd81c744190de5f4a21f267b0f"
Jul 29 04:42:31.961337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:42:31.961308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:09.101726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.101676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:09.367268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367181    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:43:09.367615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367598    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:09.367615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367615    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367623    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367631    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367651    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac0dcb9c-d517-452b-977a-391090f0408c" containerName="payload-processing"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367657    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac0dcb9c-d517-452b-977a-391090f0408c" containerName="payload-processing"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367677    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe534b61-1c8b-49b8-974c-bc37a39928ef" containerName="maas-api"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367682    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe534b61-1c8b-49b8-974c-bc37a39928ef" containerName="maas-api"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367688    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3c42a0e-5870-41c2-8034-d3bb9ccebf72" containerName="revoke-keys"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367693    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3c42a0e-5870-41c2-8034-d3bb9ccebf72" containerName="revoke-keys"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367768    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367776    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe534b61-1c8b-49b8-974c-bc37a39928ef" containerName="maas-api"
Jul 29 04:43:09.367778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367784    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3c42a0e-5870-41c2-8034-d3bb9ccebf72" containerName="revoke-keys"
Jul 29 04:43:09.368169 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.367793    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac0dcb9c-d517-452b-977a-391090f0408c" containerName="payload-processing"
Jul 29 04:43:09.370688 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.370673    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.373002 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.372984    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-994302ee-openshift-default-dockercfg-l5vdp\""
Jul 29 04:43:09.377135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377107    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377225 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377137    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xgbx4\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377225 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377225 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377279    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377409 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377452 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.377490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.377454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.382331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.382310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:43:09.397134 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.397110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:09.478089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xgbx4\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478331    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.478578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.479010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.479010 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.478996    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.479290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.479264    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.479564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.479544    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.479712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.479691    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.481442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.481417    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.481654 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.481639    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.485614 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.485591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xgbx4\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.485696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.485616    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token\") pod \"e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") " pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.502431 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.502389    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:09.682640 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.682560    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:09.815770 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.815730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:43:09.817231 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:43:09.817205    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21f0ba8d_9acd_4d03_a60e_9d9e02c85287.slice/crio-a89df79aee7a87bb66c6d9dd1b25bac774cd798e0c95d58cb01224d17c8e41e5 WatchSource:0}: Error finding container a89df79aee7a87bb66c6d9dd1b25bac774cd798e0c95d58cb01224d17c8e41e5: Status 404 returned error can't find the container with id a89df79aee7a87bb66c6d9dd1b25bac774cd798e0c95d58cb01224d17c8e41e5
Jul 29 04:43:09.819390 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.819358    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:09.819464 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.819424    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:09.819464 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:09.819452    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:10.437713 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:10.437673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerStarted","Data":"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"}
Jul 29 04:43:10.438211 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:10.437726    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerStarted","Data":"a89df79aee7a87bb66c6d9dd1b25bac774cd798e0c95d58cb01224d17c8e41e5"}
Jul 29 04:43:10.458178 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:10.458133    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podStartSLOduration=1.458118121 podStartE2EDuration="1.458118121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:43:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:43:10.456604377 +0000 UTC m=+2380.731621246" watchObservedRunningTime="2026-07-29 04:43:10.458118121 +0000 UTC m=+2380.733134909"
Jul 29 04:43:10.683470 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:10.683437    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:10.687880 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:10.687814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:11.442519 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:11.442490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:11.443524 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:11.443507    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:12.355933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.355895    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:12.457202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.457171    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:43:12.457555 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.457543    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb2b1469-6d22-4fe6-a459-c332e48971a0" containerName="istio-proxy"
Jul 29 04:43:12.460656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.460636    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.467771 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.467671    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-994302ee-serving-cert\""
Jul 29 04:43:12.467771 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.467685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:43:12.468559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.468541    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:43:12.468654 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.468573    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:43:12.477007 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.476985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:12.478667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.478641    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:43:12.505542 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.505516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7wcd\" (UniqueName: \"kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.505736 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.505711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.505844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.505820    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.593810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.593773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:12.607113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.607053    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.607113 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.607089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.607243 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.607131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7wcd\" (UniqueName: \"kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.607243 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:43:12.607201    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-serving-cert: secret "maas-api-e2e-mt-994302ee-serving-cert" not found
Jul 29 04:43:12.607310 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:43:12.607263    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls podName:1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0 nodeName:}" failed. No retries permitted until 2026-07-29 04:43:13.10724594 +0000 UTC m=+2383.382262718 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls") pod "maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" (UID: "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0") : secret "maas-api-e2e-mt-994302ee-serving-cert" not found
Jul 29 04:43:12.607700 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.607681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.617239 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.617221    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7wcd\" (UniqueName: \"kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:12.699060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:12.699026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:13.112495 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.112448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:13.114794 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.114767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") pod \"maas-api-e2e-mt-994302ee-5497f48c69-r2vvv\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:13.298576 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.298542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:13.370962 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.370887    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:13.396117 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.396090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:13.509889 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.509857    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:43:13.512313 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:43:13.512272    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ec409e4_e3cb_415e_8b0b_bbe5e747a0a0.slice/crio-228a9e9f242a4e450da6ac3991f3f7091c032f4015f013114975f6b37b52ac08 WatchSource:0}: Error finding container 228a9e9f242a4e450da6ac3991f3f7091c032f4015f013114975f6b37b52ac08: Status 404 returned error can't find the container with id 228a9e9f242a4e450da6ac3991f3f7091c032f4015f013114975f6b37b52ac08
Jul 29 04:43:13.514325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:13.514302    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:43:14.461016 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:14.460982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" event={"ID":"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0","Type":"ContainerStarted","Data":"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"}
Jul 29 04:43:14.461312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:14.461039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" event={"ID":"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0","Type":"ContainerStarted","Data":"228a9e9f242a4e450da6ac3991f3f7091c032f4015f013114975f6b37b52ac08"}
Jul 29 04:43:14.461312 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:14.461099    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:14.477061 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:14.477013    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" podStartSLOduration=2.058298052 podStartE2EDuration="2.476995857s" totalImagesPullingTime="418.697805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:43:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:43:14.476874613 +0000 UTC m=+2384.751891415" watchObservedRunningTime="2026-07-29 04:43:14.476995857 +0000 UTC m=+2384.752012646"
Jul 29 04:43:20.472132 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:20.472101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:43:26.444518 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.444431    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 29 04:43:26.444940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.444524    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 29 04:43:26.527718 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.527687    2578 generic.go:356] "Generic (PLEG): container finished" podID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerID="287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347" exitCode=0
Jul 29 04:43:26.527878 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.527775    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerDied","Data":"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"}
Jul 29 04:43:26.528260 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.528242    2578 scope.go:117] "RemoveContainer" containerID="287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"
Jul 29 04:43:26.529328 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.529300    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:26.529402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.529368    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:26.529440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:26.529414    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:43:27.538660 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:27.538618    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerStarted","Data":"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"}
Jul 29 04:43:27.683729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:27.683694    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:27.683949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:27.683927    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 29 04:43:27.684003 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:27.683974    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 29 04:43:28.683173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:28.683140    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 29 04:43:28.683653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:28.683198    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 29 04:43:29.683928 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:29.683890    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 29 04:43:29.684340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:29.683950    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 29 04:43:30.314838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:30.314807    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:43:30.319187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:30.319166    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:43:30.683762 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:30.683660    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Jul 29 04:43:30.683762 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:30.683711    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Jul 29 04:43:31.687127 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:31.687097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:31.687596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:31.687582    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:31.688383 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:31.688363    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:43:37.330052 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:37.330005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:43:57.064560 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:43:57.064477    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:17.105188 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:17.105153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:17.171822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:17.171795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:21.825108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.825078    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"]
Jul 29 04:44:21.828509 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.828490    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:21.830946 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.830922    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:44:21.836897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.836362    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"]
Jul 29 04:44:21.880785 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.880733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-994302ee-xsdwx\" (UID: \"06641b7a-a8b3-4c67-93cc-4273ba941228\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:21.981453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.981420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-994302ee-xsdwx\" (UID: \"06641b7a-a8b3-4c67-93cc-4273ba941228\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:21.982081 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:21.982062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-994302ee-xsdwx\" (UID: \"06641b7a-a8b3-4c67-93cc-4273ba941228\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:22.140367 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:22.140287    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:22.475867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:22.475838    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"]
Jul 29 04:44:22.477850 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:44:22.477826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06641b7a_a8b3_4c67_93cc_4273ba941228.slice/crio-683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10 WatchSource:0}: Error finding container 683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10: Status 404 returned error can't find the container with id 683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10
Jul 29 04:44:22.823777 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:22.823727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx" event={"ID":"06641b7a-a8b3-4c67-93cc-4273ba941228","Type":"ContainerStarted","Data":"bfb430436dbf3e2d5220200935baaff12cf087e10e207cb0a4c55aac411e9dbe"}
Jul 29 04:44:22.823886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:22.823798    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx" event={"ID":"06641b7a-a8b3-4c67-93cc-4273ba941228","Type":"ContainerStarted","Data":"683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10"}
Jul 29 04:44:22.838522 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:22.838472    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx" podStartSLOduration=1.838458953 podStartE2EDuration="1.838458953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:44:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:44:22.837109677 +0000 UTC m=+2453.112126464" watchObservedRunningTime="2026-07-29 04:44:22.838458953 +0000 UTC m=+2453.113475740"
Jul 29 04:44:23.831048 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:23.831015    2578 generic.go:356] "Generic (PLEG): container finished" podID="06641b7a-a8b3-4c67-93cc-4273ba941228" containerID="bfb430436dbf3e2d5220200935baaff12cf087e10e207cb0a4c55aac411e9dbe" exitCode=0
Jul 29 04:44:23.831206 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:23.831100    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx" event={"ID":"06641b7a-a8b3-4c67-93cc-4273ba941228","Type":"ContainerDied","Data":"bfb430436dbf3e2d5220200935baaff12cf087e10e207cb0a4c55aac411e9dbe"}
Jul 29 04:44:24.968247 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:24.968222    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:25.005572 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.005543    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca\") pod \"06641b7a-a8b3-4c67-93cc-4273ba941228\" (UID: \"06641b7a-a8b3-4c67-93cc-4273ba941228\") "
Jul 29 04:44:25.005931 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.005906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "06641b7a-a8b3-4c67-93cc-4273ba941228" (UID: "06641b7a-a8b3-4c67-93cc-4273ba941228"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:44:25.107089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.107021    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/06641b7a-a8b3-4c67-93cc-4273ba941228-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:44:25.842669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.842629    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx" event={"ID":"06641b7a-a8b3-4c67-93cc-4273ba941228","Type":"ContainerDied","Data":"683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10"}
Jul 29 04:44:25.842892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.842698    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="683ca50c92bbd9d2644bd2e9715624f04a29b3517dfa2c6ac8a765dba9a72b10"
Jul 29 04:44:25.842892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:25.842640    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"
Jul 29 04:44:28.406895 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:28.406861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:28.459378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:28.459343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:37.209236 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.209207    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:44:37.209677 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.209406    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" podUID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" containerName="maas-api" containerID="cri-o://bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c" gracePeriod=30
Jul 29 04:44:37.237111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.237081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:37.337765 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.337722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:37.394033 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.394000    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"]
Jul 29 04:44:37.396286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.396262    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-994302ee-xsdwx"]
Jul 29 04:44:37.402407 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.402383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:37.459401 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.459342    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:44:37.623850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.623818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca\") pod \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") "
Jul 29 04:44:37.624032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.623874    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") pod \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") "
Jul 29 04:44:37.624032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.623916    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x7wcd\" (UniqueName: \"kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd\") pod \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\" (UID: \"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0\") "
Jul 29 04:44:37.624242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.624216    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" (UID: "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:44:37.626118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.626085    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" (UID: "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:44:37.626203 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.626101    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd" (OuterVolumeSpecName: "kube-api-access-x7wcd") pod "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" (UID: "1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0"). InnerVolumeSpecName "kube-api-access-x7wcd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:44:37.725337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.725271    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:44:37.725337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.725295    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x7wcd\" (UniqueName: \"kubernetes.io/projected/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-kube-api-access-x7wcd\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:44:37.725337 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.725310    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:44:37.915826 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.915790    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" containerID="bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c" exitCode=0
Jul 29 04:44:37.915984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.915845    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"
Jul 29 04:44:37.915984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.915874    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" event={"ID":"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0","Type":"ContainerDied","Data":"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"}
Jul 29 04:44:37.915984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.915939    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv" event={"ID":"1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0","Type":"ContainerDied","Data":"228a9e9f242a4e450da6ac3991f3f7091c032f4015f013114975f6b37b52ac08"}
Jul 29 04:44:37.915984 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.915972    2578 scope.go:117] "RemoveContainer" containerID="bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"
Jul 29 04:44:37.925570 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.925552    2578 scope.go:117] "RemoveContainer" containerID="bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"
Jul 29 04:44:37.925867 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:44:37.925849    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c\": container with ID starting with bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c not found: ID does not exist" containerID="bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"
Jul 29 04:44:37.925924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.925875    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c"} err="failed to get container status \"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c\": rpc error: code = NotFound desc = could not find container \"bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c\": container with ID starting with bc8aba0db906ca3278400dc0dda940aa671a93aca0c9004d53e6e51cabf6811c not found: ID does not exist"
Jul 29 04:44:37.937824 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.937797    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:44:37.941120 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:37.941098    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-994302ee-5497f48c69-r2vvv"]
Jul 29 04:44:38.195803 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:38.195777    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06641b7a-a8b3-4c67-93cc-4273ba941228" path="/var/lib/kubelet/pods/06641b7a-a8b3-4c67-93cc-4273ba941228/volumes"
Jul 29 04:44:38.196142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:38.196129    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" path="/var/lib/kubelet/pods/1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0/volumes"
Jul 29 04:44:40.536194 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:40.536157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:44:45.563508 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:44:45.563475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:00.134555 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.134518    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"]
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.134949    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" containerName="maas-api"
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.134964    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" containerName="maas-api"
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.134973    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06641b7a-a8b3-4c67-93cc-4273ba941228" containerName="revoke-keys"
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.134978    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="06641b7a-a8b3-4c67-93cc-4273ba941228" containerName="revoke-keys"
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.135037    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="06641b7a-a8b3-4c67-93cc-4273ba941228" containerName="revoke-keys"
Jul 29 04:45:00.135097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.135047    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ec409e4-e3cb-415e-8b0b-bbe5e747a0a0" containerName="maas-api"
Jul 29 04:45:00.139394 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.139375    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"
Jul 29 04:45:00.142135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.142104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:45:00.145227 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.145197    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"]
Jul 29 04:45:00.150999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.150974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"
Jul 29 04:45:00.282346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:00.282323    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"]
Jul 29 04:45:00.284049 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:45:00.284023    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod106d0a0c_aa39_4506_9b95_d3e5baedff63.slice/crio-2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0 WatchSource:0}: Error finding container 2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0: Status 404 returned error can't find the container with id 2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0
Jul 29 04:45:01.037204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:01.037163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb" event={"ID":"106d0a0c-aa39-4506-9b95-d3e5baedff63","Type":"ContainerStarted","Data":"c0a48269968e2be7f36346de04cd5dc8c6c8107b2845954bad37f0fa9c9286bb"}
Jul 29 04:45:01.037368 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:01.037215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb" event={"ID":"106d0a0c-aa39-4506-9b95-d3e5baedff63","Type":"ContainerStarted","Data":"2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0"}
Jul 29 04:45:01.052619 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:01.052569    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb" podStartSLOduration=1.052554546 podStartE2EDuration="1.052554546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:45:01.051142013 +0000 UTC m=+2491.326158814" watchObservedRunningTime="2026-07-29 04:45:01.052554546 +0000 UTC m=+2491.327571334"
Jul 29 04:45:02.043693 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:02.043661    2578 generic.go:356] "Generic (PLEG): container finished" podID="106d0a0c-aa39-4506-9b95-d3e5baedff63" containerID="c0a48269968e2be7f36346de04cd5dc8c6c8107b2845954bad37f0fa9c9286bb" exitCode=0
Jul 29 04:45:02.044157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:02.043764    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb" event={"ID":"106d0a0c-aa39-4506-9b95-d3e5baedff63","Type":"ContainerDied","Data":"c0a48269968e2be7f36346de04cd5dc8c6c8107b2845954bad37f0fa9c9286bb"}
Jul 29 04:45:03.179406 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:03.179380    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"
Jul 29 04:45:04.055844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:04.055812    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb"
Jul 29 04:45:04.056018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:04.055844    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29755005-m9qlb" event={"ID":"106d0a0c-aa39-4506-9b95-d3e5baedff63","Type":"ContainerDied","Data":"2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0"}
Jul 29 04:45:04.056018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:04.055897    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ab9e295a1b8be971e5d56c11035588611a673a334a945df106aa291d332a6a0"
Jul 29 04:45:21.760242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:21.760209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:23.153687 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:23.153608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:28.186926 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.186893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:28.245902 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.245874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:28.491600 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.491511    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:45:28.491802 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.491774    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" containerID="cri-o://02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1" gracePeriod=30
Jul 29 04:45:28.534575 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.534534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:28.705453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:28.705423    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:31.689155 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:31.689110    2578 patch_prober.go:28] interesting pod/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:45:31.689658 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:31.689202    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:45:33.745740 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.745715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:45:33.890878 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.890848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.890893    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.890927    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xgbx4\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.890958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.890976    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891011    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891049 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891041    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891113    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs\") pod \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\" (UID: \"21f0ba8d-9acd-4d03-a60e-9d9e02c85287\") "
Jul 29 04:45:33.891373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891317    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:33.891373 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891356    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:33.891593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891420    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:45:33.891593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891452    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.891593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891470    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.891593 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891530    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:33.891908 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.891882    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data" (OuterVolumeSpecName: "istio-data") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:33.893105 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.893075    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:45:33.893205 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.893176    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4" (OuterVolumeSpecName: "kube-api-access-xgbx4") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "kube-api-access-xgbx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:45:33.893314 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.893294    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token" (OuterVolumeSpecName: "istio-token") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:45:33.893405 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.893390    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "21f0ba8d-9acd-4d03-a60e-9d9e02c85287" (UID: "21f0ba8d-9acd-4d03-a60e-9d9e02c85287"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:45:33.992088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992059    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992087    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xgbx4\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-kube-api-access-xgbx4\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992102    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992114    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992125    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992136    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:33.992242 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:33.992146    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/21f0ba8d-9acd-4d03-a60e-9d9e02c85287-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:45:34.224850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.224823    2578 generic.go:356] "Generic (PLEG): container finished" podID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerID="02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1" exitCode=0
Jul 29 04:45:34.224979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.224861    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"
Jul 29 04:45:34.224979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.224915    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerDied","Data":"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"}
Jul 29 04:45:34.224979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.224963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl" event={"ID":"21f0ba8d-9acd-4d03-a60e-9d9e02c85287","Type":"ContainerDied","Data":"a89df79aee7a87bb66c6d9dd1b25bac774cd798e0c95d58cb01224d17c8e41e5"}
Jul 29 04:45:34.225083 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.224986    2578 scope.go:117] "RemoveContainer" containerID="02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"
Jul 29 04:45:34.233549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.233534    2578 scope.go:117] "RemoveContainer" containerID="287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"
Jul 29 04:45:34.241243 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.241224    2578 scope.go:117] "RemoveContainer" containerID="02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"
Jul 29 04:45:34.241580 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:45:34.241545    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1\": container with ID starting with 02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1 not found: ID does not exist" containerID="02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"
Jul 29 04:45:34.241679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.241579    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1"} err="failed to get container status \"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1\": rpc error: code = NotFound desc = could not find container \"02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1\": container with ID starting with 02ab2d9f3cf8d94aa7f9ed6b877f229b13ce2b792ab2d37b4e88682595b5c4c1 not found: ID does not exist"
Jul 29 04:45:34.241679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.241600    2578 scope.go:117] "RemoveContainer" containerID="287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"
Jul 29 04:45:34.242165 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:45:34.242092    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347\": container with ID starting with 287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347 not found: ID does not exist" containerID="287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"
Jul 29 04:45:34.242165 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.242124    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347"} err="failed to get container status \"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347\": rpc error: code = NotFound desc = could not find container \"287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347\": container with ID starting with 287aade1f7e22d38fd37822e6cfd5b887c0de59e1dc1366ee3e6c5de91290347 not found: ID does not exist"
Jul 29 04:45:34.245500 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.245478    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:45:34.247909 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:34.247891    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-994302ee-openshift-default-654fcf5d48-hgrbl"]
Jul 29 04:45:36.195522 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:36.195488    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" path="/var/lib/kubelet/pods/21f0ba8d-9acd-4d03-a60e-9d9e02c85287/volumes"
Jul 29 04:45:39.953569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:39.953537    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:40.056258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:40.056231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:40.151874 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:40.151836    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:51.114222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:51.114181    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:51.214653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:51.214622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:51.314340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:51.314310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:52.713111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:52.713066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:58.513971 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:58.513933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:58.616141 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:58.616108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:45:59.281547 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:45:59.281516    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:04.947445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:04.947407    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:05.054872 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:05.054845    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:05.148627 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:05.148592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:15.644003 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:15.643967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:26.218348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:26.218308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:30.477989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:30.477951    2578 scope.go:117] "RemoveContainer" containerID="43ba3aa7ed22e17157af266b895b11fa7e39320a1503419a0417fb08f30b9f6f"
Jul 29 04:46:47.207246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:47.207209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:53.194159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.194074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:53.294334 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.294301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:53.546726 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.546698    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:53.819543 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.819453    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:46:53.819916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.819897    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:53.819916 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.819916    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:53.820086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.819943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="106d0a0c-aa39-4506-9b95-d3e5baedff63" containerName="cleanup"
Jul 29 04:46:53.820086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.819951    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="106d0a0c-aa39-4506-9b95-d3e5baedff63" containerName="cleanup"
Jul 29 04:46:53.820086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.820053    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:53.820086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.820064    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="106d0a0c-aa39-4506-9b95-d3e5baedff63" containerName="cleanup"
Jul 29 04:46:53.820086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.820077    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:53.823235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.823213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.825634 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.825601    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-e021d8-openshift-default-dockercfg-ql7xs\""
Jul 29 04:46:53.833944 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.833918    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:46:53.842162 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.842123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:53.933259 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5n2p\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.933602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.933540    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:53.941053 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:53.941020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:54.034372 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034336    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5n2p\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034372 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034374    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034644 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034655    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034737    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.034919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.034884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.035168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.035080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.035168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.035146    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.035255 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.035236    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.036774 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.036739    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.037028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.037009    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.042378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.042356    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.042589 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.042569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5n2p\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p\") pod \"e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") " pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.134684 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.134599    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:54.271268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.271243    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:46:54.273036 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:46:54.273002    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61563997_9c78_47e2_8b59_21e4052f211a.slice/crio-713911db21d351ae2575a1e804f06426ed1f35646cbf7a688c543fb2cef7b4d9 WatchSource:0}: Error finding container 713911db21d351ae2575a1e804f06426ed1f35646cbf7a688c543fb2cef7b4d9: Status 404 returned error can't find the container with id 713911db21d351ae2575a1e804f06426ed1f35646cbf7a688c543fb2cef7b4d9
Jul 29 04:46:54.275201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.275169    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:46:54.275258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.275238    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:46:54.275303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.275269    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:46:54.637527 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.637491    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerStarted","Data":"20fb2519a50017c552cda49acd13f7b623d3b070068c3f56c8ba8ac41dba0ac0"}
Jul 29 04:46:54.637715 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.637546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerStarted","Data":"713911db21d351ae2575a1e804f06426ed1f35646cbf7a688c543fb2cef7b4d9"}
Jul 29 04:46:54.658453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:54.658404    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podStartSLOduration=1.658387855 podStartE2EDuration="1.658387855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:46:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:46:54.656260256 +0000 UTC m=+2604.931277045" watchObservedRunningTime="2026-07-29 04:46:54.658387855 +0000 UTC m=+2604.933404643"
Jul 29 04:46:55.134997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:55.134958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:55.139697 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:55.139673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:55.643429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:55.643396    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:55.644422 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:55.644404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:46:56.534412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.534373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:56.627043 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.627010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:56.629009 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.628982    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:46:56.629402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.629386    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:56.629402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.629401    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="21f0ba8d-9acd-4d03-a60e-9d9e02c85287" containerName="istio-proxy"
Jul 29 04:46:56.632550 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.632532    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.635104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.635085    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:46:56.635210 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.635126    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:46:56.636274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.636258    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-e021d8-serving-cert\""
Jul 29 04:46:56.636322 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.636302    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:46:56.643814 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.643793    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:46:56.691057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.691030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:56.759313 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.759276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.759510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.759326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.759510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.759438    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rrvjx\" (UniqueName: \"kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.860223 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.860133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rrvjx\" (UniqueName: \"kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.860223 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.860209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.860416 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.860232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.860416 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:46:56.860316    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-serving-cert: secret "maas-api-e2e-inf-a-e021d8-serving-cert" not found
Jul 29 04:46:56.860416 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:46:56.860378    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls podName:5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f nodeName:}" failed. No retries permitted until 2026-07-29 04:46:57.360361021 +0000 UTC m=+2607.635377787 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls") pod "maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" (UID: "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f") : secret "maas-api-e2e-inf-a-e021d8-serving-cert" not found
Jul 29 04:46:56.860880 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.860859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:56.873030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:56.873005    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rrvjx\" (UniqueName: \"kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:57.010226 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.010188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:57.116292 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.116199    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:57.212015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.211979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:46:57.251172 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.251136    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:46:57.254808 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.254786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.257733 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.257707    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-e021d8-dockercfg-vsf6f\""
Jul 29 04:46:57.258099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.258081    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-e021d8\""
Jul 29 04:46:57.265219 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.265195    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:46:57.363945 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.363908    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g49k6\" (UniqueName: \"kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.364101 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.363963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:57.364101 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.364016    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.366395 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.366344    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") pod \"maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:57.465376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.465340    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g49k6\" (UniqueName: \"kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.465544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.465391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.466088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.466068    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.473140 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.473118    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g49k6\" (UniqueName: \"kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6\") pod \"payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") " pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.544132 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.544085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:57.566509 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.566480    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:57.696051 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.696013    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:46:57.696474 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:46:57.696445    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fed2ab5_9611_47d4_a6a9_c7a1b78a9c0f.slice/crio-ccd41de093e37c9142dfe2fb6d77b5d2002e7aa065f44692dc9f22e13b4952e0 WatchSource:0}: Error finding container ccd41de093e37c9142dfe2fb6d77b5d2002e7aa065f44692dc9f22e13b4952e0: Status 404 returned error can't find the container with id ccd41de093e37c9142dfe2fb6d77b5d2002e7aa065f44692dc9f22e13b4952e0
Jul 29 04:46:57.724435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:57.724405    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:46:57.726038 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:46:57.726013    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb26493_197e_4697_b221_de04e03c4a25.slice/crio-1d06d304b4b3e1eb3aa37a3ac4a9015c6e269643ff27bf83444ba843db1d80a8 WatchSource:0}: Error finding container 1d06d304b4b3e1eb3aa37a3ac4a9015c6e269643ff27bf83444ba843db1d80a8: Status 404 returned error can't find the container with id 1d06d304b4b3e1eb3aa37a3ac4a9015c6e269643ff27bf83444ba843db1d80a8
Jul 29 04:46:58.662471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.662435    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" event={"ID":"1cb26493-197e-4697-b221-de04e03c4a25","Type":"ContainerStarted","Data":"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"}
Jul 29 04:46:58.662662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.662484    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" event={"ID":"1cb26493-197e-4697-b221-de04e03c4a25","Type":"ContainerStarted","Data":"1d06d304b4b3e1eb3aa37a3ac4a9015c6e269643ff27bf83444ba843db1d80a8"}
Jul 29 04:46:58.662662 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.662528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:46:58.663935 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.663913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" event={"ID":"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f","Type":"ContainerStarted","Data":"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"}
Jul 29 04:46:58.664066 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.663958    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:46:58.664066 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.663976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" event={"ID":"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f","Type":"ContainerStarted","Data":"ccd41de093e37c9142dfe2fb6d77b5d2002e7aa065f44692dc9f22e13b4952e0"}
Jul 29 04:46:58.677703 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.677659    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" podStartSLOduration=1.67764575 podStartE2EDuration="1.67764575s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:46:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:46:58.67610438 +0000 UTC m=+2608.951121169" watchObservedRunningTime="2026-07-29 04:46:58.67764575 +0000 UTC m=+2608.952662924"
Jul 29 04:46:58.691526 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:46:58.691480    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" podStartSLOduration=2.314583789 podStartE2EDuration="2.691466045s" totalImagesPullingTime="376.882256ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:46:58.690579144 +0000 UTC m=+2608.965595957" watchObservedRunningTime="2026-07-29 04:46:58.691466045 +0000 UTC m=+2608.966482832"
Jul 29 04:47:04.675914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:04.675886    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:47:09.672341 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:09.672289    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:47:11.035032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.034431    2578 patch_prober.go:28] interesting pod/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:55616->10.132.0.65:15021: read: connection reset by peer" start-of-body=
Jul 29 04:47:11.035032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.034495    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": read tcp 10.132.0.2:55616->10.132.0.65:15021: read: connection reset by peer"
Jul 29 04:47:11.737854 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.737820    2578 generic.go:356] "Generic (PLEG): container finished" podID="61563997-9c78-47e2-8b59-21e4052f211a" containerID="20fb2519a50017c552cda49acd13f7b623d3b070068c3f56c8ba8ac41dba0ac0" exitCode=0
Jul 29 04:47:11.738025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.737888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerDied","Data":"20fb2519a50017c552cda49acd13f7b623d3b070068c3f56c8ba8ac41dba0ac0"}
Jul 29 04:47:11.738266 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.738252    2578 scope.go:117] "RemoveContainer" containerID="20fb2519a50017c552cda49acd13f7b623d3b070068c3f56c8ba8ac41dba0ac0"
Jul 29 04:47:11.739355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.739327    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:11.739427 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.739408    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:11.739469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:11.739445    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:12.755609 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:12.755567    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerStarted","Data":"cd3f2d03939a57c7166ec96be61b587733c53181666d0480f97098a3f732d62b"}
Jul 29 04:47:13.135668 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:13.135621    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:47:13.136060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:13.136034    2578 patch_prober.go:28] interesting pod/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 04:47:13.136233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:13.136210    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 04:47:14.135539 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:14.135495    2578 patch_prober.go:28] interesting pod/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 04:47:14.136060 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:14.135561    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 04:47:15.135761 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:15.135697    2578 patch_prober.go:28] interesting pod/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 04:47:15.136266 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:15.135793    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 04:47:16.135184 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:16.135136    2578 patch_prober.go:28] interesting pod/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body=
Jul 29 04:47:16.135407 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:16.135205    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused"
Jul 29 04:47:17.139032 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:17.139002    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:47:17.139412 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:17.139377    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:47:17.140166 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:17.140151    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:47:21.514035 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:21.514001    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:21.846258 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:21.846174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:22.108602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.108532    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:47:22.112218 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.112194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.114697 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.114676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-ff425c-openshift-default-dockercfg-lzbpz\""
Jul 29 04:47:22.124166 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.124136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:47:22.136524 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.136503    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:22.186097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186097 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pds4p\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186151    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186240 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186290    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.186371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.186321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287550 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287575    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287703    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pds4p\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287776    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.287978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.287831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.288251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.288082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.288251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.288162    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.288251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.288180    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.288251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.288227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.288445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.288318    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.290003 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.289980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.290094 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.290027    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.295315 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.295287    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pds4p\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.295400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.295382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token\") pod \"e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") " pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.350603 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.350560    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:22.423929 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.423866    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:22.590384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.590348    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:47:22.590916 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:47:22.590892    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7184252c_39ce_4080_8f6d_944e04c712d9.slice/crio-22763994b3ce4c7a8eed11b77ecf5b2034009ce249c6fb0e24a0de53271d8cf0 WatchSource:0}: Error finding container 22763994b3ce4c7a8eed11b77ecf5b2034009ce249c6fb0e24a0de53271d8cf0: Status 404 returned error can't find the container with id 22763994b3ce4c7a8eed11b77ecf5b2034009ce249c6fb0e24a0de53271d8cf0
Jul 29 04:47:22.592921 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.592889    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:22.592992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.592956    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:22.592992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.592982    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:22.810924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.810888    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerStarted","Data":"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"}
Jul 29 04:47:22.811116 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.810948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerStarted","Data":"22763994b3ce4c7a8eed11b77ecf5b2034009ce249c6fb0e24a0de53271d8cf0"}
Jul 29 04:47:22.829083 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:22.829020    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podStartSLOduration=0.828999683 podStartE2EDuration="828.999683ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:47:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:47:22.827830206 +0000 UTC m=+2633.102847019" watchObservedRunningTime="2026-07-29 04:47:22.828999683 +0000 UTC m=+2633.104016474"
Jul 29 04:47:23.424821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:23.424787    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:23.429893 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:23.429868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:23.816815 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:23.816775    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:23.817862 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:23.817843    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:24.739810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.739734    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:24.776087 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.776050    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:47:24.779861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.779835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:24.782456 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.782430    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-ff425c-serving-cert\""
Jul 29 04:47:24.787738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.787709    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:47:24.842285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.842245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:24.912730 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.912690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:24.913031 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.913001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7wvvm\" (UniqueName: \"kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:24.913118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.913060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:24.939982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:24.939936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:25.013548 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.013511    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.013813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.013593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7wvvm\" (UniqueName: \"kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.013813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.013624    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.014301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.014281    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.016124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.016099    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.022367 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.022341    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7wvvm\" (UniqueName: \"kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm\") pod \"maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.041043 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.041006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:25.093272 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.093229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:25.233118 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.233095    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:47:25.234554 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:47:25.234528    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3950994c_456d_4563_b115_0544076f51f4.slice/crio-7e8a2bfcbef270c25584f15ce647fc26119b047d9771ceb547d78d13c7661c45 WatchSource:0}: Error finding container 7e8a2bfcbef270c25584f15ce647fc26119b047d9771ceb547d78d13c7661c45: Status 404 returned error can't find the container with id 7e8a2bfcbef270c25584f15ce647fc26119b047d9771ceb547d78d13c7661c45
Jul 29 04:47:25.363793 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.363683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:25.458397 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.458363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:47:25.832980 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.832937    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" event={"ID":"3950994c-456d-4563-b115-0544076f51f4","Type":"ContainerStarted","Data":"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"}
Jul 29 04:47:25.833154 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.833007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" event={"ID":"3950994c-456d-4563-b115-0544076f51f4","Type":"ContainerStarted","Data":"7e8a2bfcbef270c25584f15ce647fc26119b047d9771ceb547d78d13c7661c45"}
Jul 29 04:47:25.851731 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:25.851680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" podStartSLOduration=1.448060567 podStartE2EDuration="1.851664638s" totalImagesPullingTime="403.604071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:47:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:47:25.848914745 +0000 UTC m=+2636.123931533" watchObservedRunningTime="2026-07-29 04:47:25.851664638 +0000 UTC m=+2636.126681425"
Jul 29 04:47:26.838121 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:26.838083    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:32.853892 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:32.853860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:47:37.903376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.903289    2578 generic.go:356] "Generic (PLEG): container finished" podID="7184252c-39ce-4080-8f6d-944e04c712d9" containerID="436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6" exitCode=0
Jul 29 04:47:37.903376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.903363    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerDied","Data":"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"}
Jul 29 04:47:37.903858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.903742    2578 scope.go:117] "RemoveContainer" containerID="436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"
Jul 29 04:47:37.904811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.904779    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:37.904924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.904849    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:37.904924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:37.904880    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:47:38.816971 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:38.816937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:38.910284 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:38.910250    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerStarted","Data":"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"}
Jul 29 04:47:39.424351 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:39.424304    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:39.425646 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:39.425613    2578 patch_prober.go:28] interesting pod/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 29 04:47:39.425840 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:39.425697    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 29 04:47:40.425104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:40.425069    2578 patch_prober.go:28] interesting pod/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 29 04:47:40.425505 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:40.425125    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 29 04:47:41.424602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:41.424566    2578 patch_prober.go:28] interesting pod/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 29 04:47:41.424819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:41.424625    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 29 04:47:42.424368 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:42.424327    2578 patch_prober.go:28] interesting pod/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Jul 29 04:47:42.424819 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:42.424400    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Jul 29 04:47:43.428791 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:43.428758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:43.429245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:43.429224    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:43.429865 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:43.429848    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:47:49.692063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:47:49.692030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:48:05.033208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:48:05.033172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:48:30.350156 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:48:30.350122    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:48:30.377413 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:48:30.377386    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:48:33.027538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:48:33.027507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:14.264293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:14.264262    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:15.217875 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.217847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:15.325349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.325315    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"]
Jul 29 04:49:15.328621 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.328605    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:15.331146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.331127    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:49:15.335687 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.335668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"]
Jul 29 04:49:15.472811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.472718    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd\" (UID: \"27780d64-6554-4cba-aedb-dfc3c64f8be5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:15.573970 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.573944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd\" (UID: \"27780d64-6554-4cba-aedb-dfc3c64f8be5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:15.574506 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.574489    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd\" (UID: \"27780d64-6554-4cba-aedb-dfc3c64f8be5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:15.640532 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.640508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:15.767531 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:15.767500    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"]
Jul 29 04:49:15.768280 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:49:15.768251    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27780d64_6554_4cba_aedb_dfc3c64f8be5.slice/crio-ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5 WatchSource:0}: Error finding container ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5: Status 404 returned error can't find the container with id ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5
Jul 29 04:49:16.443997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:16.443966    2578 generic.go:356] "Generic (PLEG): container finished" podID="27780d64-6554-4cba-aedb-dfc3c64f8be5" containerID="19e7fb97b200dfec5be74f6e038ac8783fa747f16bc1b4d9a251e81921013625" exitCode=0
Jul 29 04:49:16.444293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:16.444042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd" event={"ID":"27780d64-6554-4cba-aedb-dfc3c64f8be5","Type":"ContainerDied","Data":"19e7fb97b200dfec5be74f6e038ac8783fa747f16bc1b4d9a251e81921013625"}
Jul 29 04:49:16.444293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:16.444091    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd" event={"ID":"27780d64-6554-4cba-aedb-dfc3c64f8be5","Type":"ContainerStarted","Data":"ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5"}
Jul 29 04:49:17.580785 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:17.580762    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:17.691998 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:17.691970    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca\") pod \"27780d64-6554-4cba-aedb-dfc3c64f8be5\" (UID: \"27780d64-6554-4cba-aedb-dfc3c64f8be5\") "
Jul 29 04:49:17.692280 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:17.692260    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "27780d64-6554-4cba-aedb-dfc3c64f8be5" (UID: "27780d64-6554-4cba-aedb-dfc3c64f8be5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:17.792553 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:17.792528    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/27780d64-6554-4cba-aedb-dfc3c64f8be5-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:18.456028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:18.455957    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"
Jul 29 04:49:18.456148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:18.455951    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd" event={"ID":"27780d64-6554-4cba-aedb-dfc3c64f8be5","Type":"ContainerDied","Data":"ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5"}
Jul 29 04:49:18.456148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:18.456080    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ad822da0b731eadcda538877583f3d4a798279623b058103ad0c138c3e4a5db5"
Jul 29 04:49:25.854011 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.853976    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:49:25.854453 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.854206    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" podUID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" containerName="maas-api" containerID="cri-o://0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a" gracePeriod=30
Jul 29 04:49:25.884079 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.884055    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:25.910110 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.910079    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:49:25.910375 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.910319    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" podUID="1cb26493-197e-4697-b221-de04e03c4a25" containerName="payload-processing" containerID="cri-o://1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01" gracePeriod=30
Jul 29 04:49:25.987342 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:25.987316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:26.048091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.048058    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"]
Jul 29 04:49:26.049817 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.049768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:26.050529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.050510    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-e021d8-9g7hd"]
Jul 29 04:49:26.197384 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.197347    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:49:26.197682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.197661    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27780d64-6554-4cba-aedb-dfc3c64f8be5" path="/var/lib/kubelet/pods/27780d64-6554-4cba-aedb-dfc3c64f8be5/volumes"
Jul 29 04:49:26.316740 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.316717    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:49:26.368871 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.368847    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g49k6\" (UniqueName: \"kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6\") pod \"1cb26493-197e-4697-b221-de04e03c4a25\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") "
Jul 29 04:49:26.368985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.368913    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume\") pod \"1cb26493-197e-4697-b221-de04e03c4a25\" (UID: \"1cb26493-197e-4697-b221-de04e03c4a25\") "
Jul 29 04:49:26.369298 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.369261    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1cb26493-197e-4697-b221-de04e03c4a25" (UID: "1cb26493-197e-4697-b221-de04e03c4a25"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:26.369371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.369355    2578 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1cb26493-197e-4697-b221-de04e03c4a25-plugins-config-volume\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:26.370976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.370955    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6" (OuterVolumeSpecName: "kube-api-access-g49k6") pod "1cb26493-197e-4697-b221-de04e03c4a25" (UID: "1cb26493-197e-4697-b221-de04e03c4a25"). InnerVolumeSpecName "kube-api-access-g49k6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:26.439168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.439111    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:26.470226 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.470196    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca\") pod \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") "
Jul 29 04:49:26.470327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.470239    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rrvjx\" (UniqueName: \"kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx\") pod \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") "
Jul 29 04:49:26.470378 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.470358    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") pod \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\" (UID: \"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f\") "
Jul 29 04:49:26.470564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.470532    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" (UID: "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:26.470657 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.470565    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g49k6\" (UniqueName: \"kubernetes.io/projected/1cb26493-197e-4697-b221-de04e03c4a25-kube-api-access-g49k6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:26.472294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.472274    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" (UID: "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:49:26.472428 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.472412    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx" (OuterVolumeSpecName: "kube-api-access-rrvjx") pod "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" (UID: "5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f"). InnerVolumeSpecName "kube-api-access-rrvjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:26.498144 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.498122    2578 generic.go:356] "Generic (PLEG): container finished" podID="1cb26493-197e-4697-b221-de04e03c4a25" containerID="1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01" exitCode=0
Jul 29 04:49:26.498235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.498167    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"
Jul 29 04:49:26.498235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.498163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" event={"ID":"1cb26493-197e-4697-b221-de04e03c4a25","Type":"ContainerDied","Data":"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"}
Jul 29 04:49:26.498235 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.498230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc" event={"ID":"1cb26493-197e-4697-b221-de04e03c4a25","Type":"ContainerDied","Data":"1d06d304b4b3e1eb3aa37a3ac4a9015c6e269643ff27bf83444ba843db1d80a8"}
Jul 29 04:49:26.498358 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.498264    2578 scope.go:117] "RemoveContainer" containerID="1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"
Jul 29 04:49:26.499608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.499578    2578 generic.go:356] "Generic (PLEG): container finished" podID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" containerID="0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a" exitCode=0
Jul 29 04:49:26.499708 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.499604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" event={"ID":"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f","Type":"ContainerDied","Data":"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"}
Jul 29 04:49:26.499708 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.499639    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"
Jul 29 04:49:26.499708 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.499655    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7" event={"ID":"5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f","Type":"ContainerDied","Data":"ccd41de093e37c9142dfe2fb6d77b5d2002e7aa065f44692dc9f22e13b4952e0"}
Jul 29 04:49:26.509638 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.509622    2578 scope.go:117] "RemoveContainer" containerID="1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"
Jul 29 04:49:26.509984 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:26.509964    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01\": container with ID starting with 1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01 not found: ID does not exist" containerID="1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"
Jul 29 04:49:26.510085 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.509990    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01"} err="failed to get container status \"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01\": rpc error: code = NotFound desc = could not find container \"1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01\": container with ID starting with 1aa8936f0697073f14587bebf9f5e11bbe1a988c0a8c01e8927e4e793a18da01 not found: ID does not exist"
Jul 29 04:49:26.510085 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.510006    2578 scope.go:117] "RemoveContainer" containerID="0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"
Jul 29 04:49:26.518514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.518494    2578 scope.go:117] "RemoveContainer" containerID="0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"
Jul 29 04:49:26.518821 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:26.518804    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a\": container with ID starting with 0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a not found: ID does not exist" containerID="0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"
Jul 29 04:49:26.518900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.518825    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a"} err="failed to get container status \"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a\": rpc error: code = NotFound desc = could not find container \"0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a\": container with ID starting with 0bbdbfbdc3d96557e7c6696aba9fdb30bc7fbfdf3e9e10deb085c82866279d3a not found: ID does not exist"
Jul 29 04:49:26.525770 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.525727    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:49:26.528291 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.528271    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-e021d8-575bb97d58-9sggc"]
Jul 29 04:49:26.529829 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:26.529810    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cb26493_197e_4697_b221_de04e03c4a25.slice\": RecentStats: unable to find data in memory cache]"
Jul 29 04:49:26.537302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.537282    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:49:26.542813 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.542792    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-e021d8-785865bcdb-n2xg7"]
Jul 29 04:49:26.571053 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.571031    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:26.571053 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.571053    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rrvjx\" (UniqueName: \"kubernetes.io/projected/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-kube-api-access-rrvjx\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:26.571178 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:26.571066    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:28.196589 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:28.196551    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1cb26493-197e-4697-b221-de04e03c4a25" path="/var/lib/kubelet/pods/1cb26493-197e-4697-b221-de04e03c4a25/volumes"
Jul 29 04:49:28.197196 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:28.197172    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" path="/var/lib/kubelet/pods/5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f/volumes"
Jul 29 04:49:32.180093 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.180058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:32.280216 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.280178    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:32.406405 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.406371    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:49:32.406653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.406613    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy" containerID="cri-o://cd3f2d03939a57c7166ec96be61b587733c53181666d0480f97098a3f732d62b" gracePeriod=30
Jul 29 04:49:32.421845 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.421820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:32.652809 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.652763    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:32.771360 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771328    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"]
Jul 29 04:49:32.771779 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771738    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27780d64-6554-4cba-aedb-dfc3c64f8be5" containerName="revoke-keys"
Jul 29 04:49:32.771779 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771774    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="27780d64-6554-4cba-aedb-dfc3c64f8be5" containerName="revoke-keys"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771794    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1cb26493-197e-4697-b221-de04e03c4a25" containerName="payload-processing"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771800    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1cb26493-197e-4697-b221-de04e03c4a25" containerName="payload-processing"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771814    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" containerName="maas-api"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771819    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" containerName="maas-api"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771883    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="27780d64-6554-4cba-aedb-dfc3c64f8be5" containerName="revoke-keys"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771892    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5fed2ab5-9611-47d4-a6a9-c7a1b78a9c0f" containerName="maas-api"
Jul 29 04:49:32.771948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.771899    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1cb26493-197e-4697-b221-de04e03c4a25" containerName="payload-processing"
Jul 29 04:49:32.776968 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.776951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:32.779642 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.779618    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-mxv5w\""
Jul 29 04:49:32.781497 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.781375    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"]
Jul 29 04:49:32.822128 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.822095    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb\" (UID: \"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:32.923663 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.923587    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb\" (UID: \"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:32.924204 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:32.924186    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb\" (UID: \"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:33.089635 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:33.089607    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:33.220306 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:33.220267    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"]
Jul 29 04:49:33.221622 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:49:33.221591    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1d1cd52_b8b7_488c_9764_fdbfb3bb7e92.slice/crio-d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab WatchSource:0}: Error finding container d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab: Status 404 returned error can't find the container with id d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab
Jul 29 04:49:33.541544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:33.541514    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb" event={"ID":"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92","Type":"ContainerStarted","Data":"d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab"}
Jul 29 04:49:34.553179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:34.553147    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" containerID="b01f8026cea59f353a7dcb2d4426e4ff92ac6a96d627a5e8ce2650b6ecfda32a" exitCode=0
Jul 29 04:49:34.553555 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:34.553230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb" event={"ID":"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92","Type":"ContainerDied","Data":"b01f8026cea59f353a7dcb2d4426e4ff92ac6a96d627a5e8ce2650b6ecfda32a"}
Jul 29 04:49:35.696088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:35.696064    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:35.745549 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:35.745525    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca\") pod \"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92\" (UID: \"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92\") "
Jul 29 04:49:35.745872 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:35.745849    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" (UID: "c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:35.846263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:35.846208    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92-maas-api-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:36.566417 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:36.566391    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"
Jul 29 04:49:36.566581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:36.566431    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb" event={"ID":"c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92","Type":"ContainerDied","Data":"d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab"}
Jul 29 04:49:36.566581 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:36.566490    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d05754918c29b093ea20846b906f72584e1cec075733a8ce4adc77e7a821fdab"
Jul 29 04:49:37.574969 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.574938    2578 generic.go:356] "Generic (PLEG): container finished" podID="61563997-9c78-47e2-8b59-21e4052f211a" containerID="cd3f2d03939a57c7166ec96be61b587733c53181666d0480f97098a3f732d62b" exitCode=0
Jul 29 04:49:37.575449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.575011    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerDied","Data":"cd3f2d03939a57c7166ec96be61b587733c53181666d0480f97098a3f732d62b"}
Jul 29 04:49:37.575449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.575070    2578 scope.go:117] "RemoveContainer" containerID="20fb2519a50017c552cda49acd13f7b623d3b070068c3f56c8ba8ac41dba0ac0"
Jul 29 04:49:37.668402 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.668381    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:49:37.759201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759122    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759201 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759157    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759207    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759234    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759261    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759310    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759351    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759403 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x5n2p\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759431    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert\") pod \"61563997-9c78-47e2-8b59-21e4052f211a\" (UID: \"61563997-9c78-47e2-8b59-21e4052f211a\") "
Jul 29 04:49:37.759626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759439    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:37.759626 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759542    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:37.759782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759652    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:37.759782 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759741    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.759897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759783    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.759897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.759877    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:37.760411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.760381    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data" (OuterVolumeSpecName: "istio-data") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:37.761559 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.761533    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token" (OuterVolumeSpecName: "istio-token") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:37.761670 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.761563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:37.761801 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.761763    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:49:37.761869 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.761800    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p" (OuterVolumeSpecName: "kube-api-access-x5n2p") pod "61563997-9c78-47e2-8b59-21e4052f211a" (UID: "61563997-9c78-47e2-8b59-21e4052f211a"). InnerVolumeSpecName "kube-api-access-x5n2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:37.860137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860111    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x5n2p\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-kube-api-access-x5n2p\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860137 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860133    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/61563997-9c78-47e2-8b59-21e4052f211a-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860143    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860151    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/61563997-9c78-47e2-8b59-21e4052f211a-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860158    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/61563997-9c78-47e2-8b59-21e4052f211a-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860165    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:37.860286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:37.860172    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/61563997-9c78-47e2-8b59-21e4052f211a-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:38.581305 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:38.581265    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2" event={"ID":"61563997-9c78-47e2-8b59-21e4052f211a","Type":"ContainerDied","Data":"713911db21d351ae2575a1e804f06426ed1f35646cbf7a688c543fb2cef7b4d9"}
Jul 29 04:49:38.581721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:38.581340    2578 scope.go:117] "RemoveContainer" containerID="cd3f2d03939a57c7166ec96be61b587733c53181666d0480f97098a3f732d62b"
Jul 29 04:49:38.581721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:38.581285    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"
Jul 29 04:49:38.599634 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:38.599587    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:49:38.602929 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:38.602908    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-e021d8-openshift-default-685b98795d-ksbg2"]
Jul 29 04:49:40.197859 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:40.197830    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="61563997-9c78-47e2-8b59-21e4052f211a" path="/var/lib/kubelet/pods/61563997-9c78-47e2-8b59-21e4052f211a/volumes"
Jul 29 04:49:43.140511 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.140480    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:49:43.140935 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.140679    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" podUID="3950994c-456d-4563-b115-0544076f51f4" containerName="maas-api" containerID="cri-o://6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089" gracePeriod=30
Jul 29 04:49:43.165524 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.165500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:43.265952 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.265920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:43.325482 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.325454    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"]
Jul 29 04:49:43.327833 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.327732    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ff425c-b7bvb"]
Jul 29 04:49:43.339863 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.338825    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:43.396667 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.396604    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:49:43.504795 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.504765    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca\") pod \"3950994c-456d-4563-b115-0544076f51f4\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") "
Jul 29 04:49:43.504976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.504839    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7wvvm\" (UniqueName: \"kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm\") pod \"3950994c-456d-4563-b115-0544076f51f4\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") "
Jul 29 04:49:43.504976 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.504889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls\") pod \"3950994c-456d-4563-b115-0544076f51f4\" (UID: \"3950994c-456d-4563-b115-0544076f51f4\") "
Jul 29 04:49:43.505162 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.505130    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3950994c-456d-4563-b115-0544076f51f4" (UID: "3950994c-456d-4563-b115-0544076f51f4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:43.506940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.506915    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm" (OuterVolumeSpecName: "kube-api-access-7wvvm") pod "3950994c-456d-4563-b115-0544076f51f4" (UID: "3950994c-456d-4563-b115-0544076f51f4"). InnerVolumeSpecName "kube-api-access-7wvvm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:43.507061 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.507016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3950994c-456d-4563-b115-0544076f51f4" (UID: "3950994c-456d-4563-b115-0544076f51f4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:49:43.606167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.606133    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3950994c-456d-4563-b115-0544076f51f4-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:43.606167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.606160    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3950994c-456d-4563-b115-0544076f51f4-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:43.606167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.606168    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7wvvm\" (UniqueName: \"kubernetes.io/projected/3950994c-456d-4563-b115-0544076f51f4-kube-api-access-7wvvm\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:43.608481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.608455    2578 generic.go:356] "Generic (PLEG): container finished" podID="3950994c-456d-4563-b115-0544076f51f4" containerID="6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089" exitCode=0
Jul 29 04:49:43.608615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.608498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"
Jul 29 04:49:43.608615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.608533    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" event={"ID":"3950994c-456d-4563-b115-0544076f51f4","Type":"ContainerDied","Data":"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"}
Jul 29 04:49:43.608615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.608588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng" event={"ID":"3950994c-456d-4563-b115-0544076f51f4","Type":"ContainerDied","Data":"7e8a2bfcbef270c25584f15ce647fc26119b047d9771ceb547d78d13c7661c45"}
Jul 29 04:49:43.608790 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.608618    2578 scope.go:117] "RemoveContainer" containerID="6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"
Jul 29 04:49:43.618394 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.618377    2578 scope.go:117] "RemoveContainer" containerID="6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"
Jul 29 04:49:43.618626 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:43.618608    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089\": container with ID starting with 6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089 not found: ID does not exist" containerID="6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"
Jul 29 04:49:43.618668 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.618635    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089"} err="failed to get container status \"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089\": rpc error: code = NotFound desc = could not find container \"6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089\": container with ID starting with 6a905d5c956a3ae9c3a565123bd1e2a2a634843fc099c797290c75f427a0c089 not found: ID does not exist"
Jul 29 04:49:43.629623 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.629601    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:49:43.633039 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.633020    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-ff425c-69bdc5df6c-nm2ng"]
Jul 29 04:49:43.688289 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:43.688230    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:44.195975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:44.195934    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3950994c-456d-4563-b115-0544076f51f4" path="/var/lib/kubelet/pods/3950994c-456d-4563-b115-0544076f51f4/volumes"
Jul 29 04:49:44.196455 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:44.196419    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" path="/var/lib/kubelet/pods/c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92/volumes"
Jul 29 04:49:49.760762 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:49.760712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:49.858187 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:49.858149    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:49.999621 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:49.999588    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:49:49.999876 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:49.999853    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy" containerID="cri-o://a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1" gracePeriod=30
Jul 29 04:49:50.014898 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.014832    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:50.243087 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.243050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:50.570696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.570659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:50.909430 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:49:50.909841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909771    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:50.909841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909814    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:50.909841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909837    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3950994c-456d-4563-b115-0544076f51f4" containerName="maas-api"
Jul 29 04:49:50.909841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909846    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3950994c-456d-4563-b115-0544076f51f4" containerName="maas-api"
Jul 29 04:49:50.909990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909856    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" containerName="revoke-keys"
Jul 29 04:49:50.909990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909861    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" containerName="revoke-keys"
Jul 29 04:49:50.909990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909926    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:50.909990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909935    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d1cd52-b8b7-488c-9764-fdbfb3bb7e92" containerName="revoke-keys"
Jul 29 04:49:50.909990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.909943    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3950994c-456d-4563-b115-0544076f51f4" containerName="maas-api"
Jul 29 04:49:50.914401 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.914381    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.916874 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.916858    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-09567c-openshift-default-dockercfg-6lgvt\""
Jul 29 04:49:50.924696 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.924668    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:49:50.933707 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.933679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:50.962063 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962067    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962084    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962148 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgl2f\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:50.962400 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:50.962305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063274 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063495 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063495 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063580 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063580 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063578    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063669 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgl2f\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063673    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.063807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063729    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.064023 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.063993    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.064158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.064023    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.064158 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.064141    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.064284 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.064178    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.065700 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.065681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.065904 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.065886    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.071557 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.071532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.071648 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.071637    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgl2f\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f\") pod \"e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") " pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.227055 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.226983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:51.360979 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.360951    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:49:51.362151 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:49:51.362124    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod248cb596_1a8a_44f6_8b3e_a5760df03087.slice/crio-e2c86d839d04bade28728ff7399f3743fe7f10bc6029ad0247d12b0bca55c7cf WatchSource:0}: Error finding container e2c86d839d04bade28728ff7399f3743fe7f10bc6029ad0247d12b0bca55c7cf: Status 404 returned error can't find the container with id e2c86d839d04bade28728ff7399f3743fe7f10bc6029ad0247d12b0bca55c7cf
Jul 29 04:49:51.364169 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.364131    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:49:51.364270 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.364207    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:49:51.364270 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.364252    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:49:51.492147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.492050    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:51.656249 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.656215    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerStarted","Data":"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"}
Jul 29 04:49:51.656416 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.656268    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerStarted","Data":"e2c86d839d04bade28728ff7399f3743fe7f10bc6029ad0247d12b0bca55c7cf"}
Jul 29 04:49:51.676285 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:51.676232    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podStartSLOduration=1.676218012 podStartE2EDuration="1.676218012s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:49:51.673428521 +0000 UTC m=+2781.948445309" watchObservedRunningTime="2026-07-29 04:49:51.676218012 +0000 UTC m=+2781.951234798"
Jul 29 04:49:52.227833 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:52.227800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:52.232622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:52.232597    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:52.665233 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:52.665162    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:52.666124 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:52.666101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:49:53.547366 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.547334    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:53.644213 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.644179    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:53.769772 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.769722    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:49:53.770131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.770117    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:53.770131 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.770132    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:53.770269 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.770206    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="61563997-9c78-47e2-8b59-21e4052f211a" containerName="istio-proxy"
Jul 29 04:49:53.778088 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.778069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.780859 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.780838    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:49:53.781180 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.780871    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:49:53.781465 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.780912    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-09567c-serving-cert\""
Jul 29 04:49:53.781583 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.780952    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:49:53.782933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.782913    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:49:53.814838 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.814766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:53.892034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.886627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5lvh\" (UniqueName: \"kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.892034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.886710    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.892034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.886793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.987706 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.987679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5lvh\" (UniqueName: \"kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.987870 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.987716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.987870 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.987758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.988330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.988306    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.990109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.990088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:53.996615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:53.996592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5lvh\" (UniqueName: \"kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh\") pod \"maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:54.003595 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.003567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:54.091924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.091869    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:54.220712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.220688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:49:54.222502 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:49:54.222465    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod530bd77c_9cd0_405f_909c_8f97863fe171.slice/crio-b3abd9a4f73c8e639f665dc5f77effa8f02adf64dc35406b7e45fa9f1d8dd8ea WatchSource:0}: Error finding container b3abd9a4f73c8e639f665dc5f77effa8f02adf64dc35406b7e45fa9f1d8dd8ea: Status 404 returned error can't find the container with id b3abd9a4f73c8e639f665dc5f77effa8f02adf64dc35406b7e45fa9f1d8dd8ea
Jul 29 04:49:54.223845 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.223828    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:49:54.300225 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.300196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:54.396507 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.396426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:49:54.676772 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:54.676727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" event={"ID":"530bd77c-9cd0-405f-909c-8f97863fe171","Type":"ContainerStarted","Data":"b3abd9a4f73c8e639f665dc5f77effa8f02adf64dc35406b7e45fa9f1d8dd8ea"}
Jul 29 04:49:55.251763 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.251729    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:49:55.301791 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301737    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.301957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.301957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.301957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301880    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.301957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301945    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.302193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301983    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.302193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.301986    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:55.302193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302008    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pds4p\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.302193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.302193 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy\") pod \"7184252c-39ce-4080-8f6d-944e04c712d9\" (UID: \"7184252c-39ce-4080-8f6d-944e04c712d9\") "
Jul 29 04:49:55.302459 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302192    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:49:55.302525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302454    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.302525 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302481    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7184252c-39ce-4080-8f6d-944e04c712d9-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.303011 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.302981    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:55.303145 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.303032    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:55.303145 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.303047    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:55.304254 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.304225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:49:55.304364 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.304277    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p" (OuterVolumeSpecName: "kube-api-access-pds4p") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "kube-api-access-pds4p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:55.304414 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.304359    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:49:55.304486 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.304469    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "7184252c-39ce-4080-8f6d-944e04c712d9" (UID: "7184252c-39ce-4080-8f6d-944e04c712d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:49:55.403157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403128    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403154    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403157 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403162    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7184252c-39ce-4080-8f6d-944e04c712d9-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403170    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403178    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403185    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7184252c-39ce-4080-8f6d-944e04c712d9-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.403349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.403193    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pds4p\" (UniqueName: \"kubernetes.io/projected/7184252c-39ce-4080-8f6d-944e04c712d9-kube-api-access-pds4p\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:49:55.685202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.685081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" event={"ID":"530bd77c-9cd0-405f-909c-8f97863fe171","Type":"ContainerStarted","Data":"ee081f2eeee96d8908a4b7af315677135f94feba72d4f51290d848705cf477c8"}
Jul 29 04:49:55.685202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.685149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:49:55.686801 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.686773    2578 generic.go:356] "Generic (PLEG): container finished" podID="7184252c-39ce-4080-8f6d-944e04c712d9" containerID="a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1" exitCode=0
Jul 29 04:49:55.686912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.686818    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"
Jul 29 04:49:55.686912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.686861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerDied","Data":"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"}
Jul 29 04:49:55.686912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.686909    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr" event={"ID":"7184252c-39ce-4080-8f6d-944e04c712d9","Type":"ContainerDied","Data":"22763994b3ce4c7a8eed11b77ecf5b2034009ce249c6fb0e24a0de53271d8cf0"}
Jul 29 04:49:55.687065 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.686934    2578 scope.go:117] "RemoveContainer" containerID="a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"
Jul 29 04:49:55.696327 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.696311    2578 scope.go:117] "RemoveContainer" containerID="436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"
Jul 29 04:49:55.702251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.702211    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" podStartSLOduration=2.297851404 podStartE2EDuration="2.702197833s" totalImagesPullingTime="404.346429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:49:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:49:55.699778858 +0000 UTC m=+2785.974795647" watchObservedRunningTime="2026-07-29 04:49:55.702197833 +0000 UTC m=+2785.977214685"
Jul 29 04:49:55.705302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.705282    2578 scope.go:117] "RemoveContainer" containerID="a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"
Jul 29 04:49:55.705554 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:55.705535    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1\": container with ID starting with a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1 not found: ID does not exist" containerID="a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"
Jul 29 04:49:55.705596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.705562    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1"} err="failed to get container status \"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1\": rpc error: code = NotFound desc = could not find container \"a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1\": container with ID starting with a1a708bb676a31e6ac77cccba3fa8d77a7dc60df1e4e3ff61d38de74df990eb1 not found: ID does not exist"
Jul 29 04:49:55.705596 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.705579    2578 scope.go:117] "RemoveContainer" containerID="436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"
Jul 29 04:49:55.705825 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:49:55.705808    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6\": container with ID starting with 436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6 not found: ID does not exist" containerID="436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"
Jul 29 04:49:55.705879 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.705829    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6"} err="failed to get container status \"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6\": rpc error: code = NotFound desc = could not find container \"436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6\": container with ID starting with 436239db96d6a603af155dd0ded5880fc46cebcd39195e8dad7446bb03f758c6 not found: ID does not exist"
Jul 29 04:49:55.712712 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.712690    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:49:55.719588 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:55.719566    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-ff425c-openshift-default-5569798cc6-7tfcr"]
Jul 29 04:49:56.195948 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:49:56.195919    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" path="/var/lib/kubelet/pods/7184252c-39ce-4080-8f6d-944e04c712d9/volumes"
Jul 29 04:50:01.698729 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:01.698701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:50:06.754180 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.754110    2578 generic.go:356] "Generic (PLEG): container finished" podID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerID="5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d" exitCode=0
Jul 29 04:50:06.754569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.754178    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerDied","Data":"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"}
Jul 29 04:50:06.754615 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.754584    2578 scope.go:117] "RemoveContainer" containerID="5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"
Jul 29 04:50:06.755540 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.755513    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:06.755591 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.755575    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:06.755628 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:06.755603    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:07.665679 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:07.665647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:50:07.761822 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:07.761765    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerStarted","Data":"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"}
Jul 29 04:50:08.228129 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:08.228095    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:50:08.229501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:08.229472    2578 patch_prober.go:28] interesting pod/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 29 04:50:08.229621 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:08.229532    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 29 04:50:09.228464 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:09.228425    2578 patch_prober.go:28] interesting pod/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 29 04:50:09.229103 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:09.229063    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 29 04:50:10.227742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:10.227702    2578 patch_prober.go:28] interesting pod/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 29 04:50:10.227978 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:10.227790    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 29 04:50:11.228173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:11.228136    2578 patch_prober.go:28] interesting pod/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body=
Jul 29 04:50:11.228770 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:11.228720    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused"
Jul 29 04:50:12.231514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:12.231485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:50:12.231919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:12.231799    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:50:12.232551 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:12.232533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:50:18.552179 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:18.552147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:19.001648 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.001565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:19.276319 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.276284    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:50:19.276647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.276634    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:19.276693 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.276650    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:19.276728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.276717    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:19.276728 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.276724    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:19.278701 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.278684    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.281072 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.281051    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-c3ff84-openshift-default-dockercfg-2q9m2\""
Jul 29 04:50:19.291089 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.291060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:50:19.304198 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.304172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:19.419300 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419264    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419506 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419506 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419506 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419506 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwcrz\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419640    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419672 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.419810 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.419678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520708 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520708 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520738    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520782    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.520974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hwcrz\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.520994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.521106    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.521214    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.521393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.521435    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.521694 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.521674    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.523168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.523149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.523304 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.523285    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.528763 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.528685    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.528876 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.528774    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwcrz\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz\") pod \"e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") " pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.588853 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.588828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:19.678389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.678359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:19.725268 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.725239    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:50:19.726593 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:50:19.726571    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod165e067d_8970_406d_ba96_5be09f9fa535.slice/crio-83845572c9ab5f7e72ced29eba0993793c489b3869deb2e8dd285998818af69b WatchSource:0}: Error finding container 83845572c9ab5f7e72ced29eba0993793c489b3869deb2e8dd285998818af69b: Status 404 returned error can't find the container with id 83845572c9ab5f7e72ced29eba0993793c489b3869deb2e8dd285998818af69b
Jul 29 04:50:19.728656 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.728624    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:19.728725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.728689    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:19.728725 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.728713    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:19.828529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.828433    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerStarted","Data":"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"}
Jul 29 04:50:19.828529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.828495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerStarted","Data":"83845572c9ab5f7e72ced29eba0993793c489b3869deb2e8dd285998818af69b"}
Jul 29 04:50:19.848873 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:19.848810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podStartSLOduration=0.848790433 podStartE2EDuration="848.790433ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:50:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:50:19.846666566 +0000 UTC m=+2810.121683358" watchObservedRunningTime="2026-07-29 04:50:19.848790433 +0000 UTC m=+2810.123807223"
Jul 29 04:50:20.590029 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:20.589998    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:20.594874 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:20.594850    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:20.834539 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:20.834510    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:20.835639 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:20.835617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:21.746816 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.746782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:21.868882 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.868854    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:50:21.869362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.869348    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:21.869407 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.869367    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7184252c-39ce-4080-8f6d-944e04c712d9" containerName="istio-proxy"
Jul 29 04:50:21.871682 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.871663    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:21.874435 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.874413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-c3ff84-serving-cert\""
Jul 29 04:50:21.882695 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.882660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:21.886345 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.886318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:50:21.977591 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:21.977511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:22.043385 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.043356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.043544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.043399    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zt7sx\" (UniqueName: \"kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.043544 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.043420    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.144163 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.144131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.144348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.144189    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zt7sx\" (UniqueName: \"kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.144348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.144215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.144348 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:50:22.144292    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-serving-cert: secret "maas-api-e2e-api-b-c3ff84-serving-cert" not found
Jul 29 04:50:22.144517 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:50:22.144370    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls podName:19f849d3-ecc5-4cfe-9047-2407b450caed nodeName:}" failed. No retries permitted until 2026-07-29 04:50:22.644351022 +0000 UTC m=+2812.919367803 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls") pod "maas-api-e2e-api-b-c3ff84-77f8578566-86bws" (UID: "19f849d3-ecc5-4cfe-9047-2407b450caed") : secret "maas-api-e2e-api-b-c3ff84-serving-cert" not found
Jul 29 04:50:22.144925 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.144904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.155469 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.155446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zt7sx\" (UniqueName: \"kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.552310 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.552272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:22.649529 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.649497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.652123 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.652089    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") pod \"maas-api-e2e-api-b-c3ff84-77f8578566-86bws\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.654522 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.654498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:50:22.782104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.782073    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:22.913146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:22.913117    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:50:22.914977 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:50:22.914951    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19f849d3_ecc5_4cfe_9047_2407b450caed.slice/crio-36d2afe478b64a2f6c4a1106e229d045c5e7234f802e9f85649e3810ead12229 WatchSource:0}: Error finding container 36d2afe478b64a2f6c4a1106e229d045c5e7234f802e9f85649e3810ead12229: Status 404 returned error can't find the container with id 36d2afe478b64a2f6c4a1106e229d045c5e7234f802e9f85649e3810ead12229
Jul 29 04:50:23.857664 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:23.857623    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" event={"ID":"19f849d3-ecc5-4cfe-9047-2407b450caed","Type":"ContainerStarted","Data":"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"}
Jul 29 04:50:23.858151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:23.857688    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:23.858151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:23.857705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" event={"ID":"19f849d3-ecc5-4cfe-9047-2407b450caed","Type":"ContainerStarted","Data":"36d2afe478b64a2f6c4a1106e229d045c5e7234f802e9f85649e3810ead12229"}
Jul 29 04:50:23.874966 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:23.874923    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" podStartSLOduration=2.5260147440000003 podStartE2EDuration="2.874909328s" totalImagesPullingTime="348.894584ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:50:23.873718955 +0000 UTC m=+2814.148735931" watchObservedRunningTime="2026-07-29 04:50:23.874909328 +0000 UTC m=+2814.149926115"
Jul 29 04:50:29.869206 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:29.869174    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:50:30.535015 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:30.534988    2578 scope.go:117] "RemoveContainer" containerID="bfb430436dbf3e2d5220200935baaff12cf087e10e207cb0a4c55aac411e9dbe"
Jul 29 04:50:36.875943 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:36.875901    2578 patch_prober.go:28] interesting pod/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 04:50:36.876379 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:36.875977    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 04:50:38.943404 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.943369    2578 generic.go:356] "Generic (PLEG): container finished" podID="165e067d-8970-406d-ba96-5be09f9fa535" containerID="8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e" exitCode=0
Jul 29 04:50:38.943982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.943445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerDied","Data":"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"}
Jul 29 04:50:38.943982 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.943972    2578 scope.go:117] "RemoveContainer" containerID="8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"
Jul 29 04:50:38.944989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.944961    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:38.945091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.945029    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:38.945091 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:38.945061    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:50:39.953633 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:39.953596    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerStarted","Data":"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"}
Jul 29 04:50:40.590018 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:40.589986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:40.590222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:40.590162    2578 patch_prober.go:28] interesting pod/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 04:50:40.590303 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:40.590213    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 04:50:41.589940 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:41.589894    2578 patch_prober.go:28] interesting pod/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 04:50:41.590341 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:41.589957    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 04:50:42.589541 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:42.589502    2578 patch_prober.go:28] interesting pod/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 04:50:42.589733 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:42.589572    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 04:50:43.589408 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:43.589373    2578 patch_prober.go:28] interesting pod/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Jul 29 04:50:43.589834 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:43.589425    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Jul 29 04:50:44.592853 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:44.592824    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:44.593257 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:44.593075    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:44.593714 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:44.593698    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:50:46.713845 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:50:46.713805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:04.885637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:04.885599    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:51:04.886329 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:04.885868    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" podUID="530bd77c-9cd0-405f-909c-8f97863fe171" containerName="maas-api" containerID="cri-o://ee081f2eeee96d8908a4b7af315677135f94feba72d4f51290d848705cf477c8" gracePeriod=30
Jul 29 04:51:04.914806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:04.914783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:05.016331 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.016276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:05.086797 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.086761    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:05.098163 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.098139    2578 generic.go:356] "Generic (PLEG): container finished" podID="530bd77c-9cd0-405f-909c-8f97863fe171" containerID="ee081f2eeee96d8908a4b7af315677135f94feba72d4f51290d848705cf477c8" exitCode=0
Jul 29 04:51:05.098367 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.098209    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" event={"ID":"530bd77c-9cd0-405f-909c-8f97863fe171","Type":"ContainerDied","Data":"ee081f2eeee96d8908a4b7af315677135f94feba72d4f51290d848705cf477c8"}
Jul 29 04:51:05.146622 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.146550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:05.147025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.147011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:51:05.255992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.255960    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls\") pod \"530bd77c-9cd0-405f-909c-8f97863fe171\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") "
Jul 29 04:51:05.256197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.256029    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5lvh\" (UniqueName: \"kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh\") pod \"530bd77c-9cd0-405f-909c-8f97863fe171\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") "
Jul 29 04:51:05.256197 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.256086    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca\") pod \"530bd77c-9cd0-405f-909c-8f97863fe171\" (UID: \"530bd77c-9cd0-405f-909c-8f97863fe171\") "
Jul 29 04:51:05.256503 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.256480    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "530bd77c-9cd0-405f-909c-8f97863fe171" (UID: "530bd77c-9cd0-405f-909c-8f97863fe171"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:51:05.258349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.258316    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "530bd77c-9cd0-405f-909c-8f97863fe171" (UID: "530bd77c-9cd0-405f-909c-8f97863fe171"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:51:05.258449 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.258390    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh" (OuterVolumeSpecName: "kube-api-access-z5lvh") pod "530bd77c-9cd0-405f-909c-8f97863fe171" (UID: "530bd77c-9cd0-405f-909c-8f97863fe171"). InnerVolumeSpecName "kube-api-access-z5lvh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:05.357151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.357112    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/530bd77c-9cd0-405f-909c-8f97863fe171-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:05.357151 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.357149    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/530bd77c-9cd0-405f-909c-8f97863fe171-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:05.357349 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.357159    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5lvh\" (UniqueName: \"kubernetes.io/projected/530bd77c-9cd0-405f-909c-8f97863fe171-kube-api-access-z5lvh\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:05.445146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:05.445070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:06.104665 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.104639    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"
Jul 29 04:51:06.105173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.104681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q" event={"ID":"530bd77c-9cd0-405f-909c-8f97863fe171","Type":"ContainerDied","Data":"b3abd9a4f73c8e639f665dc5f77effa8f02adf64dc35406b7e45fa9f1d8dd8ea"}
Jul 29 04:51:06.105173 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.104741    2578 scope.go:117] "RemoveContainer" containerID="ee081f2eeee96d8908a4b7af315677135f94feba72d4f51290d848705cf477c8"
Jul 29 04:51:06.126957 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.126925    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:51:06.128997 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.128976    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-09567c-5866fbd7c7-pfk5q"]
Jul 29 04:51:06.195806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:06.195778    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="530bd77c-9cd0-405f-909c-8f97863fe171" path="/var/lib/kubelet/pods/530bd77c-9cd0-405f-909c-8f97863fe171/volumes"
Jul 29 04:51:11.151847 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.151787    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:11.251637 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.251608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:11.389147 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.389114    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:51:11.389350 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.389326    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" containerID="cri-o://b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab" gracePeriod=30
Jul 29 04:51:11.412839 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.412742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:11.626636 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:11.626597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:12.234860 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:12.234821    2578 patch_prober.go:28] interesting pod/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 04:51:12.235323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:12.234876    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 04:51:14.109578 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:14.109547    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:16.651537 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.651506    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:51:16.763676 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.763886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763686    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.763886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.763886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.763886 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763811    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763891    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763922    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgl2f\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.763978    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy\") pod \"248cb596-1a8a-44f6-8b3e-a5760df03087\" (UID: \"248cb596-1a8a-44f6-8b3e-a5760df03087\") "
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764016    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:16.764109 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:16.764389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764187    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:16.764389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764339    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:51:16.764389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764352    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.764389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764372    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.764389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764386    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.764766 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.764722    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data" (OuterVolumeSpecName: "istio-data") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:16.766323 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.766290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token" (OuterVolumeSpecName: "istio-token") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:16.766440 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.766358    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f" (OuterVolumeSpecName: "kube-api-access-pgl2f") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "kube-api-access-pgl2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:16.766569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.766551    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:16.766631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.766544    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "248cb596-1a8a-44f6-8b3e-a5760df03087" (UID: "248cb596-1a8a-44f6-8b3e-a5760df03087"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:51:16.865034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.864995    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.865034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.865028    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/248cb596-1a8a-44f6-8b3e-a5760df03087-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.865034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.865038    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.865034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.865046    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.865317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.865054    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgl2f\" (UniqueName: \"kubernetes.io/projected/248cb596-1a8a-44f6-8b3e-a5760df03087-kube-api-access-pgl2f\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:16.865317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:16.865065    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/248cb596-1a8a-44f6-8b3e-a5760df03087-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:17.164647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.164563    2578 generic.go:356] "Generic (PLEG): container finished" podID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerID="b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab" exitCode=0
Jul 29 04:51:17.164647 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.164610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"
Jul 29 04:51:17.164867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.164658    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerDied","Data":"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"}
Jul 29 04:51:17.164867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.164707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld" event={"ID":"248cb596-1a8a-44f6-8b3e-a5760df03087","Type":"ContainerDied","Data":"e2c86d839d04bade28728ff7399f3743fe7f10bc6029ad0247d12b0bca55c7cf"}
Jul 29 04:51:17.164867 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.164731    2578 scope.go:117] "RemoveContainer" containerID="b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"
Jul 29 04:51:17.174866 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.174836    2578 scope.go:117] "RemoveContainer" containerID="5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"
Jul 29 04:51:17.183429 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.183410    2578 scope.go:117] "RemoveContainer" containerID="b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"
Jul 29 04:51:17.183676 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:51:17.183653    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab\": container with ID starting with b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab not found: ID does not exist" containerID="b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"
Jul 29 04:51:17.183802 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.183683    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab"} err="failed to get container status \"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab\": rpc error: code = NotFound desc = could not find container \"b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab\": container with ID starting with b96e2c9905dac88489c91e2104d7dcba8bd6ae9036114e2f058767c4883070ab not found: ID does not exist"
Jul 29 04:51:17.183802 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.183700    2578 scope.go:117] "RemoveContainer" containerID="5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"
Jul 29 04:51:17.183982 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:51:17.183965    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d\": container with ID starting with 5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d not found: ID does not exist" containerID="5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"
Jul 29 04:51:17.184028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.183990    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d"} err="failed to get container status \"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d\": rpc error: code = NotFound desc = could not find container \"5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d\": container with ID starting with 5f101e3b68fb5f221a44819cbbf17990a02a9f6c24b38acaed6821ac3cd4129d not found: ID does not exist"
Jul 29 04:51:17.204703 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.204654    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:51:17.207915 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:17.207894    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-09567c-openshift-default-688579fcdd-pg2ld"]
Jul 29 04:51:18.195293 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:18.195258    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" path="/var/lib/kubelet/pods/248cb596-1a8a-44f6-8b3e-a5760df03087/volumes"
Jul 29 04:51:27.268371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.268331    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:51:27.268834 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.268559    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" podUID="19f849d3-ecc5-4cfe-9047-2407b450caed" containerName="maas-api" containerID="cri-o://3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1" gracePeriod=30
Jul 29 04:51:27.296954 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.296905    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:27.367844 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.367815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:27.426122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.426068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:27.483919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.483869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:27.527462 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.527398    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:51:27.551992 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.551968    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") pod \"19f849d3-ecc5-4cfe-9047-2407b450caed\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") "
Jul 29 04:51:27.552167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.552046    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zt7sx\" (UniqueName: \"kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx\") pod \"19f849d3-ecc5-4cfe-9047-2407b450caed\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") "
Jul 29 04:51:27.552167 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.552065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca\") pod \"19f849d3-ecc5-4cfe-9047-2407b450caed\" (UID: \"19f849d3-ecc5-4cfe-9047-2407b450caed\") "
Jul 29 04:51:27.552471 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.552445    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "19f849d3-ecc5-4cfe-9047-2407b450caed" (UID: "19f849d3-ecc5-4cfe-9047-2407b450caed"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:51:27.554122 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.554098    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "19f849d3-ecc5-4cfe-9047-2407b450caed" (UID: "19f849d3-ecc5-4cfe-9047-2407b450caed"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 04:51:27.554251 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.554236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx" (OuterVolumeSpecName: "kube-api-access-zt7sx") pod "19f849d3-ecc5-4cfe-9047-2407b450caed" (UID: "19f849d3-ecc5-4cfe-9047-2407b450caed"). InnerVolumeSpecName "kube-api-access-zt7sx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:27.652786 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.652741    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zt7sx\" (UniqueName: \"kubernetes.io/projected/19f849d3-ecc5-4cfe-9047-2407b450caed-kube-api-access-zt7sx\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:27.652786 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.652779    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/19f849d3-ecc5-4cfe-9047-2407b450caed-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:27.652786 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.652791    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/19f849d3-ecc5-4cfe-9047-2407b450caed-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:27.816919 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:27.816843    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:28.226914 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.226877    2578 generic.go:356] "Generic (PLEG): container finished" podID="19f849d3-ecc5-4cfe-9047-2407b450caed" containerID="3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1" exitCode=0
Jul 29 04:51:28.227057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.226938    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"
Jul 29 04:51:28.227057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.226964    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" event={"ID":"19f849d3-ecc5-4cfe-9047-2407b450caed","Type":"ContainerDied","Data":"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"}
Jul 29 04:51:28.227057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.227013    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws" event={"ID":"19f849d3-ecc5-4cfe-9047-2407b450caed","Type":"ContainerDied","Data":"36d2afe478b64a2f6c4a1106e229d045c5e7234f802e9f85649e3810ead12229"}
Jul 29 04:51:28.227057 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.227038    2578 scope.go:117] "RemoveContainer" containerID="3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"
Jul 29 04:51:28.235972 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.235955    2578 scope.go:117] "RemoveContainer" containerID="3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"
Jul 29 04:51:28.236231 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:51:28.236212    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1\": container with ID starting with 3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1 not found: ID does not exist" containerID="3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"
Jul 29 04:51:28.236283 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.236239    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1"} err="failed to get container status \"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1\": rpc error: code = NotFound desc = could not find container \"3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1\": container with ID starting with 3f08df11956a9a4af4b086d5ef11876cdf0fd7230e6b4e0a38dbe316d961a9f1 not found: ID does not exist"
Jul 29 04:51:28.244146 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.244126    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:51:28.246411 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:28.246392    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-c3ff84-77f8578566-86bws"]
Jul 29 04:51:30.195518 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:30.195478    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="19f849d3-ecc5-4cfe-9047-2407b450caed" path="/var/lib/kubelet/pods/19f849d3-ecc5-4cfe-9047-2407b450caed/volumes"
Jul 29 04:51:33.728037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:33.728003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:33.828597 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:33.828564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:33.944960 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:33.944921    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:51:33.945208 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:33.945178    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy" containerID="cri-o://acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66" gracePeriod=30
Jul 29 04:51:33.966185 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:33.966159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:34.186301 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.186266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:34.529159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.529130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:34.774764 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.774711    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 04:51:34.775232 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775214    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="19f849d3-ecc5-4cfe-9047-2407b450caed" containerName="maas-api"
Jul 29 04:51:34.775278 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775235    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="19f849d3-ecc5-4cfe-9047-2407b450caed" containerName="maas-api"
Jul 29 04:51:34.775278 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775253    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775278 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775261    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775278    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="530bd77c-9cd0-405f-909c-8f97863fe171" containerName="maas-api"
Jul 29 04:51:34.775370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775287    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="530bd77c-9cd0-405f-909c-8f97863fe171" containerName="maas-api"
Jul 29 04:51:34.775370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775303    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775370 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775311    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775400    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775412    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="530bd77c-9cd0-405f-909c-8f97863fe171" containerName="maas-api"
Jul 29 04:51:34.775489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775421    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="248cb596-1a8a-44f6-8b3e-a5760df03087" containerName="istio-proxy"
Jul 29 04:51:34.775489 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.775431    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="19f849d3-ecc5-4cfe-9047-2407b450caed" containerName="maas-api"
Jul 29 04:51:34.780126 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.780070    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.786033 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.786010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-6eef04-openshift-default-dockercfg-gd972\""
Jul 29 04:51:34.792738 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.792716    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 04:51:34.808104 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.808077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:34.818023 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818142 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rw9ln\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818176    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818263 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818223    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818302 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818382 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.818382 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.818334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rw9ln\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919342    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919389    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919442 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919438    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919611    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919782    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.919830 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.919804    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.920108 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.920084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.921848 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.921824    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.921938 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.921878    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.927487 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.927467    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:34.927707 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:34.927689    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rw9ln\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln\") pod \"e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") " pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:35.090510 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.090432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:35.113362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.113338    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:35.225219 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.225194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 04:51:35.226854 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:51:35.226825    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf89d9001_a18e_4b38_8ef9_accf63814ac6.slice/crio-6144eb225235d9b02df63b5916b7c6eb101895e45c3330804c993ad1ab1976fd WatchSource:0}: Error finding container 6144eb225235d9b02df63b5916b7c6eb101895e45c3330804c993ad1ab1976fd: Status 404 returned error can't find the container with id 6144eb225235d9b02df63b5916b7c6eb101895e45c3330804c993ad1ab1976fd
Jul 29 04:51:35.228840 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.228808    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:35.228936 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.228870    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:35.228936 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.228901    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:35.264807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:35.264773    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerStarted","Data":"6144eb225235d9b02df63b5916b7c6eb101895e45c3330804c993ad1ab1976fd"}
Jul 29 04:51:36.271364 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:36.271330    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerStarted","Data":"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"}
Jul 29 04:51:36.291811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:36.291735    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podStartSLOduration=2.291720567 podStartE2EDuration="2.291720567s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:51:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:51:36.288920768 +0000 UTC m=+2886.563937560" watchObservedRunningTime="2026-07-29 04:51:36.291720567 +0000 UTC m=+2886.566737355"
Jul 29 04:51:37.091563 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:37.091529    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:37.096563 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:37.096535    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:37.277078 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:37.277046    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:37.277985 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:37.277966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:38.191054 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.191023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:38.263959 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.263921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:38.266623 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.266596    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 04:51:38.280493 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.280447    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.282168 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.282136    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 04:51:38.287480 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.287453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-rvzxd\""
Jul 29 04:51:38.287629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.287498    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 29 04:51:38.287629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.287453    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-6eef04-serving-cert\""
Jul 29 04:51:38.287629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.287453    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 29 04:51:38.340972 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.340939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:38.350608 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.350573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8djkd\" (UniqueName: \"kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.350804 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.350683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.350858 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.350827    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.451666 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.451579    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.451666 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.451630    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.451884 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.451679    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8djkd\" (UniqueName: \"kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.452356 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.452335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.454086 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.454066    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.459788 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.459738    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8djkd\" (UniqueName: \"kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd\") pod \"maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.482815 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.482785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:38.595636 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.595600    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:38.743415 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.743385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 04:51:38.744021 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:51:38.743996    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4f1c02b_f789_477a_8f79_26259c5f3ff5.slice/crio-3756f96488fc94b72f68dba091c8c911acf8de2ed30d608a94b52ba702640ea6 WatchSource:0}: Error finding container 3756f96488fc94b72f68dba091c8c911acf8de2ed30d608a94b52ba702640ea6: Status 404 returned error can't find the container with id 3756f96488fc94b72f68dba091c8c911acf8de2ed30d608a94b52ba702640ea6
Jul 29 04:51:38.933389 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:38.933358    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:39.032101 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.032072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:39.197826 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.197801    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:51:39.262111 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262073    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262298 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262298 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262169    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262298 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262190    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262397    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262433    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262495    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hwcrz\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262517    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:39.262641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262565    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket\") pod \"165e067d-8970-406d-ba96-5be09f9fa535\" (UID: \"165e067d-8970-406d-ba96-5be09f9fa535\") "
Jul 29 04:51:39.262841 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262696    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:39.262922 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262902    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.262990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262929    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.262990 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.262904    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 04:51:39.263159 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.263134    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:39.263278 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.263251    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data" (OuterVolumeSpecName: "istio-data") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:39.264350 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.264330    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 04:51:39.264602 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.264582    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz" (OuterVolumeSpecName: "kube-api-access-hwcrz") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "kube-api-access-hwcrz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:39.264742 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.264726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 04:51:39.264807 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.264729    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token" (OuterVolumeSpecName: "istio-token") pod "165e067d-8970-406d-ba96-5be09f9fa535" (UID: "165e067d-8970-406d-ba96-5be09f9fa535"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:51:39.295538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.295465    2578 generic.go:356] "Generic (PLEG): container finished" podID="165e067d-8970-406d-ba96-5be09f9fa535" containerID="acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66" exitCode=0
Jul 29 04:51:39.295538 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.295512    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"
Jul 29 04:51:39.296052 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.295550    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerDied","Data":"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"}
Jul 29 04:51:39.296052 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.295605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99" event={"ID":"165e067d-8970-406d-ba96-5be09f9fa535","Type":"ContainerDied","Data":"83845572c9ab5f7e72ced29eba0993793c489b3869deb2e8dd285998818af69b"}
Jul 29 04:51:39.296052 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.295632    2578 scope.go:117] "RemoveContainer" containerID="acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"
Jul 29 04:51:39.297135 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.297102    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" event={"ID":"f4f1c02b-f789-477a-8f79-26259c5f3ff5","Type":"ContainerStarted","Data":"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"}
Jul 29 04:51:39.297246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.297151    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" event={"ID":"f4f1c02b-f789-477a-8f79-26259c5f3ff5","Type":"ContainerStarted","Data":"3756f96488fc94b72f68dba091c8c911acf8de2ed30d608a94b52ba702640ea6"}
Jul 29 04:51:39.305339 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.305319    2578 scope.go:117] "RemoveContainer" containerID="8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"
Jul 29 04:51:39.313245 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.313228    2578 scope.go:117] "RemoveContainer" containerID="acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"
Jul 29 04:51:39.313481 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:51:39.313463    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66\": container with ID starting with acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66 not found: ID does not exist" containerID="acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"
Jul 29 04:51:39.313530 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.313493    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66"} err="failed to get container status \"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66\": rpc error: code = NotFound desc = could not find container \"acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66\": container with ID starting with acb7b4555dabceb1ff06a7dc7b22bb0500596951639c19f97d1c638b4a0f8f66 not found: ID does not exist"
Jul 29 04:51:39.313530 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.313511    2578 scope.go:117] "RemoveContainer" containerID="8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"
Jul 29 04:51:39.313731 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:51:39.313718    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e\": container with ID starting with 8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e not found: ID does not exist" containerID="8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"
Jul 29 04:51:39.313799 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.313734    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e"} err="failed to get container status \"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e\": rpc error: code = NotFound desc = could not find container \"8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e\": container with ID starting with 8af4124be8d3407ea6b016ad6871e8cbf0e50cf83ec293bb09df696ac120df1e not found: ID does not exist"
Jul 29 04:51:39.319917 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.319874    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" podStartSLOduration=0.929156491 podStartE2EDuration="1.319860308s" totalImagesPullingTime="390.703817ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:51:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:51:39.317835434 +0000 UTC m=+2889.592852222" watchObservedRunningTime="2026-07-29 04:51:39.319860308 +0000 UTC m=+2889.594877096"
Jul 29 04:51:39.333028 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.332992    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:51:39.335318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.335296    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-c3ff84-openshift-default-57b9f55f4b-j4t99"]
Jul 29 04:51:39.364641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364603    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364638    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364641 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364648    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/165e067d-8970-406d-ba96-5be09f9fa535-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364656    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364665    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/165e067d-8970-406d-ba96-5be09f9fa535-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364674    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hwcrz\" (UniqueName: \"kubernetes.io/projected/165e067d-8970-406d-ba96-5be09f9fa535-kube-api-access-hwcrz\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:39.364890 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:39.364683    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/165e067d-8970-406d-ba96-5be09f9fa535-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:51:40.196590 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:40.196557    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="165e067d-8970-406d-ba96-5be09f9fa535" path="/var/lib/kubelet/pods/165e067d-8970-406d-ba96-5be09f9fa535/volumes"
Jul 29 04:51:40.303991 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:40.303957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:46.314286 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:46.314259    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 04:51:47.642438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:47.642384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:51:51.378569 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.378540    2578 generic.go:356] "Generic (PLEG): container finished" podID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerID="7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379" exitCode=0
Jul 29 04:51:51.378989 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.378613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerDied","Data":"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"}
Jul 29 04:51:51.379043 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.379010    2578 scope.go:117] "RemoveContainer" containerID="7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"
Jul 29 04:51:51.379974 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.379949    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:51.380034 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.380014    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:51.380069 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:51.380046    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:51:52.277294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:52.277256    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:52.386217 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:52.386181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerStarted","Data":"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"}
Jul 29 04:51:53.091310 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:53.091273    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:53.092438 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:53.092412    2578 patch_prober.go:28] interesting pod/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 29 04:51:53.092562 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:53.092462    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 29 04:51:54.091246 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:54.091207    2578 patch_prober.go:28] interesting pod/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 29 04:51:54.091639 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:54.091280    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 29 04:51:55.091806 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:55.091768    2578 patch_prober.go:28] interesting pod/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 29 04:51:55.092202 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:55.091827    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 29 04:51:56.091153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:56.091116    2578 patch_prober.go:28] interesting pod/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused" start-of-body=
Jul 29 04:51:56.091332 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:56.091172    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.76:15021/healthz/ready\": dial tcp 10.132.0.76:15021: connect: connection refused"
Jul 29 04:51:57.095250 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:57.095219    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:57.095631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:57.095501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:51:57.096265 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:51:57.096247    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 04:52:03.193861 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.193829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:03.511591 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.511555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:03.775099 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.775016    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 04:52:03.775514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.775495    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:03.775514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.775515    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:03.775665 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.775603    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:03.779065 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.779043    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.781425 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.781406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-be8bc5-openshift-default-dockercfg-pqlf2\""
Jul 29 04:52:03.788481 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788613 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788631    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788741 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h52r\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788818 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.788901 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.788877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.789053 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.789024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.791727 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.791702    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 04:52:03.803154 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.803127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:03.890199 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890166    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890242    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890268    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890362 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h52r\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890468    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890567 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890721 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890625    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890766    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890850 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890772    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.890959 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.890884    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.891153 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.891135    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.892613 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.892587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.892975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.892954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.898051 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.898031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:03.898160 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:03.898086    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h52r\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r\") pod \"e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") " pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:04.088516 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.088431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:04.225778 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.225731    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 04:52:04.226973 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:52:04.226948    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e5cc0d3_a71f_4099_91d8_87ee4f7bc9f3.slice/crio-724dd3052f997e7ece0c78c771e2e3be982643cd825075f8bc5ff1a988f26d7b WatchSource:0}: Error finding container 724dd3052f997e7ece0c78c771e2e3be982643cd825075f8bc5ff1a988f26d7b: Status 404 returned error can't find the container with id 724dd3052f997e7ece0c78c771e2e3be982643cd825075f8bc5ff1a988f26d7b
Jul 29 04:52:04.228999 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.228966    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:04.229095 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.229030    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:04.229095 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.229059    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:04.452815 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.452707    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerStarted","Data":"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"}
Jul 29 04:52:04.452815 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.452782    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerStarted","Data":"724dd3052f997e7ece0c78c771e2e3be982643cd825075f8bc5ff1a988f26d7b"}
Jul 29 04:52:04.485237 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.485189    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podStartSLOduration=1.485173914 podStartE2EDuration="1.485173914s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:52:04.483677119 +0000 UTC m=+2914.758693906" watchObservedRunningTime="2026-07-29 04:52:04.485173914 +0000 UTC m=+2914.760190701"
Jul 29 04:52:04.490904 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:04.490875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:05.089351 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:05.089320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:05.094444 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:05.094420    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:05.458007 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:05.457925    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:05.458732 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:05.458715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:06.370683 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.370644    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:06.473576 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.473549    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 04:52:06.473949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.473936    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:06.473949 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.473949    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:06.474030 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.474009    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="165e067d-8970-406d-ba96-5be09f9fa535" containerName="istio-proxy"
Jul 29 04:52:06.477294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.477274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.480035 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.480014    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-be8bc5-serving-cert\""
Jul 29 04:52:06.492490 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.492466    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 04:52:06.498406 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.498387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:06.516912 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.516892    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.517008 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.516936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttqwx\" (UniqueName: \"kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.517008 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.516969    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.610107 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.610076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:06.618340 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.618315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.618426 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.618361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttqwx\" (UniqueName: \"kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.618426 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.618391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.618492 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:52:06.618467    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-serving-cert: secret "maas-api-e2e-shared-b-be8bc5-serving-cert" not found
Jul 29 04:52:06.618573 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:52:06.618544    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls podName:eda5bff9-904f-4553-9fc9-064638eaa41b nodeName:}" failed. No retries permitted until 2026-07-29 04:52:07.118526088 +0000 UTC m=+2917.393542865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls") pod "maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" (UID: "eda5bff9-904f-4553-9fc9-064638eaa41b") : secret "maas-api-e2e-shared-b-be8bc5-serving-cert" not found
Jul 29 04:52:06.619064 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.619046    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.630329 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.630268    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttqwx\" (UniqueName: \"kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:06.722445 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:06.722415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:07.041061 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.041028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:07.122900 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.122866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:07.125314 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.125272    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") pod \"maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:07.128368 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.128320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:07.388025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.387940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:07.543545 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:07.543516    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 04:52:07.544439 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:52:07.544412    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeda5bff9_904f_4553_9fc9_064638eaa41b.slice/crio-82409a6828ecbd315edea5386dda72dbc2d5d71acc3bf7f7d2ca695596c0ce1a WatchSource:0}: Error finding container 82409a6828ecbd315edea5386dda72dbc2d5d71acc3bf7f7d2ca695596c0ce1a: Status 404 returned error can't find the container with id 82409a6828ecbd315edea5386dda72dbc2d5d71acc3bf7f7d2ca695596c0ce1a
Jul 29 04:52:08.476457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:08.476359    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" event={"ID":"eda5bff9-904f-4553-9fc9-064638eaa41b","Type":"ContainerStarted","Data":"382efc1ee76ce402f402c6ff9588f1607bfb728db1ad7cfa8c9de23378e2f5c0"}
Jul 29 04:52:08.476457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:08.476414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" event={"ID":"eda5bff9-904f-4553-9fc9-064638eaa41b","Type":"ContainerStarted","Data":"82409a6828ecbd315edea5386dda72dbc2d5d71acc3bf7f7d2ca695596c0ce1a"}
Jul 29 04:52:08.476457 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:08.476442    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:08.494037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:08.493981    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" podStartSLOduration=1.9681957319999999 podStartE2EDuration="2.493960703s" totalImagesPullingTime="525.764971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:52:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:52:08.493496095 +0000 UTC m=+2918.768512884" watchObservedRunningTime="2026-07-29 04:52:08.493960703 +0000 UTC m=+2918.768977492"
Jul 29 04:52:14.487259 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:14.487223    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 04:52:21.499924 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:21.499879    2578 patch_prober.go:28] interesting pod/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 29 04:52:21.500325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:21.499951    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 29 04:52:22.557476 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.557445    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerID="f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d" exitCode=0
Jul 29 04:52:22.557897 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.557516    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerDied","Data":"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"}
Jul 29 04:52:22.557975 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.557958    2578 scope.go:117] "RemoveContainer" containerID="f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"
Jul 29 04:52:22.558933 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.558908    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:22.558986 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.558973    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:22.559022 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:22.559003    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 04:52:23.567007 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:23.566975    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerStarted","Data":"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"}
Jul 29 04:52:24.088685 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:24.088649    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:24.088944 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:24.088920    2578 patch_prober.go:28] interesting pod/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 29 04:52:24.088993 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:24.088972    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 29 04:52:25.089693 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:25.089652    2578 patch_prober.go:28] interesting pod/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 29 04:52:25.090119 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:25.089720    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 29 04:52:26.089798 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:26.089737    2578 patch_prober.go:28] interesting pod/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 29 04:52:26.090195 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:26.089836    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 29 04:52:27.089617 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:27.089581    2578 patch_prober.go:28] interesting pod/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused" start-of-body=
Jul 29 04:52:27.089821 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:27.089634    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.78:15021/healthz/ready\": dial tcp 10.132.0.78:15021: connect: connection refused"
Jul 29 04:52:28.092546 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:28.092514    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:28.093020 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:28.092970    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:28.093522 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:28.093505    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 04:52:31.337280 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:31.337251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:52:41.551883 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:52:41.551850    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:53:06.611352 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:06.611267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:53:25.051318 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:25.051283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:53:30.389680 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:30.389644    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:53:30.420629 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:30.420597    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:53:53.214171 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:53.214137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:53:53.261831 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:53:53.261797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:55:04.817591 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.817552    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:04.821065 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.821047    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:04.823371 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.823350    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 29 04:55:04.824330 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.824313    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-w5qv8\""
Jul 29 04:55:04.824393 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.824313    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 29 04:55:04.829811 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.829784    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:04.851222 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.851191    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97w8s\" (UniqueName: \"kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s\") pod \"kuadrant-operator-catalog-tbclw\" (UID: \"f5cf0952-ccff-4b26-8f2f-c505ffddb128\") " pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:04.952553 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.952514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97w8s\" (UniqueName: \"kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s\") pod \"kuadrant-operator-catalog-tbclw\" (UID: \"f5cf0952-ccff-4b26-8f2f-c505ffddb128\") " pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:04.960154 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:04.960130    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-97w8s\" (UniqueName: \"kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s\") pod \"kuadrant-operator-catalog-tbclw\" (UID: \"f5cf0952-ccff-4b26-8f2f-c505ffddb128\") " pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:05.131631 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:05.131529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:05.265041 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:05.265004    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:05.266535 ip-10-0-129-12 kubenswrapper[2578]: W0729 04:55:05.266505    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5cf0952_ccff_4b26_8f2f_c505ffddb128.slice/crio-ac21581913b2ae7d107a5203ac0fd97c20a98029448fa0e5cc104db1e93af353 WatchSource:0}: Error finding container ac21581913b2ae7d107a5203ac0fd97c20a98029448fa0e5cc104db1e93af353: Status 404 returned error can't find the container with id ac21581913b2ae7d107a5203ac0fd97c20a98029448fa0e5cc104db1e93af353
Jul 29 04:55:05.267868 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:05.267847    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 04:55:05.466294 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:05.466202    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" event={"ID":"f5cf0952-ccff-4b26-8f2f-c505ffddb128","Type":"ContainerStarted","Data":"ac21581913b2ae7d107a5203ac0fd97c20a98029448fa0e5cc104db1e93af353"}
Jul 29 04:55:07.483279 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:07.483175    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" event={"ID":"f5cf0952-ccff-4b26-8f2f-c505ffddb128","Type":"ContainerStarted","Data":"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"}
Jul 29 04:55:07.500961 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:07.500899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" podStartSLOduration=1.73444065 podStartE2EDuration="3.500881884s" totalImagesPullingTime="1.766441234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 04:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 04:55:07.498721992 +0000 UTC m=+3097.773738779" watchObservedRunningTime="2026-07-29 04:55:07.500881884 +0000 UTC m=+3097.775898673"
Jul 29 04:55:12.056313 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:12.056277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:55:15.132632 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:15.132530    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:15.132632 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:15.132606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:15.154346 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:15.154318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:15.548653 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:15.548626    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:15.580421 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:15.580389    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:17.538539 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:17.538496    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" podUID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" containerName="registry-server" containerID="cri-o://bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245" gracePeriod=2
Jul 29 04:55:17.788256 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:17.788226    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:17.866564 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:17.866484    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97w8s\" (UniqueName: \"kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s\") pod \"f5cf0952-ccff-4b26-8f2f-c505ffddb128\" (UID: \"f5cf0952-ccff-4b26-8f2f-c505ffddb128\") "
Jul 29 04:55:17.868551 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:17.868518    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s" (OuterVolumeSpecName: "kube-api-access-97w8s") pod "f5cf0952-ccff-4b26-8f2f-c505ffddb128" (UID: "f5cf0952-ccff-4b26-8f2f-c505ffddb128"). InnerVolumeSpecName "kube-api-access-97w8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 04:55:17.967722 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:17.967687    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97w8s\" (UniqueName: \"kubernetes.io/projected/f5cf0952-ccff-4b26-8f2f-c505ffddb128-kube-api-access-97w8s\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 04:55:18.545501 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.545461    2578 generic.go:356] "Generic (PLEG): container finished" podID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" containerID="bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245" exitCode=0
Jul 29 04:55:18.546025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.545511    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-tbclw"
Jul 29 04:55:18.546025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.545509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" event={"ID":"f5cf0952-ccff-4b26-8f2f-c505ffddb128","Type":"ContainerDied","Data":"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"}
Jul 29 04:55:18.546025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.545576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-tbclw" event={"ID":"f5cf0952-ccff-4b26-8f2f-c505ffddb128","Type":"ContainerDied","Data":"ac21581913b2ae7d107a5203ac0fd97c20a98029448fa0e5cc104db1e93af353"}
Jul 29 04:55:18.546025 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.545607    2578 scope.go:117] "RemoveContainer" containerID="bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"
Jul 29 04:55:18.555037 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.555020    2578 scope.go:117] "RemoveContainer" containerID="bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"
Jul 29 04:55:18.555292 ip-10-0-129-12 kubenswrapper[2578]: E0729 04:55:18.555271    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245\": container with ID starting with bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245 not found: ID does not exist" containerID="bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"
Jul 29 04:55:18.555348 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.555301    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245"} err="failed to get container status \"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245\": rpc error: code = NotFound desc = could not find container \"bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245\": container with ID starting with bfb111e0f42e67ebe3293651c7df07d9eda2645939fee624325bf3148f2d5245 not found: ID does not exist"
Jul 29 04:55:18.562461 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.562437    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:18.565790 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:18.565732    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-tbclw"]
Jul 29 04:55:20.196350 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:20.196319    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" path="/var/lib/kubelet/pods/f5cf0952-ccff-4b26-8f2f-c505ffddb128/volumes"
Jul 29 04:55:30.617376 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:55:30.617345    2578 scope.go:117] "RemoveContainer" containerID="19e7fb97b200dfec5be74f6e038ac8783fa747f16bc1b4d9a251e81921013625"
Jul 29 04:56:30.643507 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:56:30.643469    2578 scope.go:117] "RemoveContainer" containerID="b01f8026cea59f353a7dcb2d4426e4ff92ac6a96d627a5e8ce2650b6ecfda32a"
Jul 29 04:57:25.792325 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:57:25.792232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:58:11.655290 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:11.655255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:58:12.552114 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:12.552074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:58:23.189466 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:23.189427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:58:30.427514 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:30.427486    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:58:30.458230 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:30.458205    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 04:58:39.264317 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:58:39.264278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:59:21.685814 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:59:21.685772    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 04:59:21.737355 ip-10-0-129-12 kubenswrapper[2578]: I0729 04:59:21.737319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:00:19.737823 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:00:19.737781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:00:21.238313 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:00:21.238276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:00:24.743577 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:00:24.743347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:00:51.221931 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:00:51.221887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:26.984080 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:26.984038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:29.046347 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:29.046307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:35.277226 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.277187    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:35.277641 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.277627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" containerName="registry-server"
Jul 29 05:02:35.277686 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.277642    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" containerName="registry-server"
Jul 29 05:02:35.277727 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.277716    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5cf0952-ccff-4b26-8f2f-c505ffddb128" containerName="registry-server"
Jul 29 05:02:35.280758 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.280734    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:35.283611 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.283585    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-djt7j\""
Jul 29 05:02:35.286174 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.286106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:35.392886 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.392844    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8j4w\" (UniqueName: \"kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w\") pod \"test-curl-7546-139922289587376\" (UID: \"07afcd9d-db18-45a6-9c0b-57cae41ea835\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:35.494240 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.494201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8j4w\" (UniqueName: \"kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w\") pod \"test-curl-7546-139922289587376\" (UID: \"07afcd9d-db18-45a6-9c0b-57cae41ea835\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:35.502730 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.502700    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8j4w\" (UniqueName: \"kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w\") pod \"test-curl-7546-139922289587376\" (UID: \"07afcd9d-db18-45a6-9c0b-57cae41ea835\") " pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:35.591575 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.591477    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:35.950055 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.950025    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:35.951296 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:02:35.951272    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07afcd9d_db18_45a6_9c0b_57cae41ea835.slice/crio-6e43c571f0b10ea79b44c35a5dab3dbec239aa123246eaad87aa0709e89268c0 WatchSource:0}: Error finding container 6e43c571f0b10ea79b44c35a5dab3dbec239aa123246eaad87aa0709e89268c0: Status 404 returned error can't find the container with id 6e43c571f0b10ea79b44c35a5dab3dbec239aa123246eaad87aa0709e89268c0
Jul 29 05:02:35.952496 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:35.952477    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 05:02:36.932946 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:36.932856    2578 generic.go:356] "Generic (PLEG): container finished" podID="07afcd9d-db18-45a6-9c0b-57cae41ea835" containerID="3623d0ebfcf8832e40b263d6f4074c8b00d4f3184264c15947663381a37ddaa5" exitCode=0
Jul 29 05:02:36.933335 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:36.932948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289587376" event={"ID":"07afcd9d-db18-45a6-9c0b-57cae41ea835","Type":"ContainerDied","Data":"3623d0ebfcf8832e40b263d6f4074c8b00d4f3184264c15947663381a37ddaa5"}
Jul 29 05:02:36.933335 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:36.932993    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7546-139922289587376" event={"ID":"07afcd9d-db18-45a6-9c0b-57cae41ea835","Type":"ContainerStarted","Data":"6e43c571f0b10ea79b44c35a5dab3dbec239aa123246eaad87aa0709e89268c0"}
Jul 29 05:02:38.074434 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.074408    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.096203 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.096171    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7546-139922289587376_07afcd9d-db18-45a6-9c0b-57cae41ea835/test-curl-7546-139922289587376/0.log"
Jul 29 05:02:38.120613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.120543    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:38.124464 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.124435    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7546-139922289587376"]
Jul 29 05:02:38.221649 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.221571    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g8j4w\" (UniqueName: \"kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w\") pod \"07afcd9d-db18-45a6-9c0b-57cae41ea835\" (UID: \"07afcd9d-db18-45a6-9c0b-57cae41ea835\") "
Jul 29 05:02:38.223666 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.223634    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w" (OuterVolumeSpecName: "kube-api-access-g8j4w") pod "07afcd9d-db18-45a6-9c0b-57cae41ea835" (UID: "07afcd9d-db18-45a6-9c0b-57cae41ea835"). InnerVolumeSpecName "kube-api-access-g8j4w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:02:38.322847 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.322784    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g8j4w\" (UniqueName: \"kubernetes.io/projected/07afcd9d-db18-45a6-9c0b-57cae41ea835-kube-api-access-g8j4w\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:02:38.944956 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.944920    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7546-139922289587376"
Jul 29 05:02:38.945166 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:38.944982    2578 scope.go:117] "RemoveContainer" containerID="3623d0ebfcf8832e40b263d6f4074c8b00d4f3184264c15947663381a37ddaa5"
Jul 29 05:02:40.197297 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:40.197258    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07afcd9d-db18-45a6-9c0b-57cae41ea835" path="/var/lib/kubelet/pods/07afcd9d-db18-45a6-9c0b-57cae41ea835/volumes"
Jul 29 05:02:47.663018 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.662980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:47.935164 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.935083    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:02:47.935523 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.935501    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07afcd9d-db18-45a6-9c0b-57cae41ea835" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:47.935604 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.935525    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07afcd9d-db18-45a6-9c0b-57cae41ea835" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:47.935666 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.935653    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07afcd9d-db18-45a6-9c0b-57cae41ea835" containerName="test-curl-7546-139922289587376"
Jul 29 05:02:47.938734 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.938715    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:47.941404 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.941380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-c210b8-openshift-default-dockercfg-dfr87\""
Jul 29 05:02:47.949068 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.949037    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:02:47.967974 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:47.967943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:48.013661 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013661 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqdcr\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013724    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013826    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.013943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.013887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.108848 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.108808    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:48.114952 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.114928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115058 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.114970    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115058 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.114996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115058 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115194 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115194 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115080    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqdcr\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115194 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115349 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115349 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115461 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115360    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115461 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115646 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115710 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115672    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.115710 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.115680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.117694 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.117671    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.117871 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.117854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.122955 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.122930    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.123057 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.122999    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqdcr\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr\") pod \"e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") " pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.250511 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.250420    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:48.394880 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.394852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:02:48.396502 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:02:48.396473    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod995b377e_9998_4a98_a3d4_d11b9226dac5.slice/crio-fab8dc230072bd1f3b659982c81b68ed1804d17c910a4fcf694f792628effb2a WatchSource:0}: Error finding container fab8dc230072bd1f3b659982c81b68ed1804d17c910a4fcf694f792628effb2a: Status 404 returned error can't find the container with id fab8dc230072bd1f3b659982c81b68ed1804d17c910a4fcf694f792628effb2a
Jul 29 05:02:48.399076 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.399039    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:02:48.399158 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.399111    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:02:48.399158 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:48.399143    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:02:49.002961 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:49.002914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerStarted","Data":"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"}
Jul 29 05:02:49.003375 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:49.003015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerStarted","Data":"fab8dc230072bd1f3b659982c81b68ed1804d17c910a4fcf694f792628effb2a"}
Jul 29 05:02:49.025681 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:49.025620    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podStartSLOduration=2.025603141 podStartE2EDuration="2.025603141s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:02:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:02:49.024146992 +0000 UTC m=+3559.299163777" watchObservedRunningTime="2026-07-29 05:02:49.025603141 +0000 UTC m=+3559.300620016"
Jul 29 05:02:49.251133 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:49.251101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:49.256481 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:49.256406    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:50.008023 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:50.007988    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:50.009033 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:50.009014    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:02:50.947531 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:50.947499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.023616 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.023587    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:02:51.026427 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.026403    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.028917 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.028894    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-a-c210b8-serving-cert\""
Jul 29 05:02:51.038134 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.038107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:02:51.039995 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.039961    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.040134 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.040116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.040213 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.040196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-495r9\" (UniqueName: \"kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.040327 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.040238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.111275 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.111234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.144322 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.144281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.144713 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.144689    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.144905 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.144886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-495r9\" (UniqueName: \"kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.145542 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:02:51.145515    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-serving-cert: secret "maas-api-e2e-ipp-a-c210b8-serving-cert" not found
Jul 29 05:02:51.145655 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:02:51.145597    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls podName:902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8 nodeName:}" failed. No retries permitted until 2026-07-29 05:02:51.645576444 +0000 UTC m=+3561.920593225 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls") pod "maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" (UID: "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8") : secret "maas-api-e2e-ipp-a-c210b8-serving-cert" not found
Jul 29 05:02:51.146480 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.146455    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.158081 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.158053    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-495r9\" (UniqueName: \"kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.250962 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.250873    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.586448 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.586414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.650540 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.650506    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.653156 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.653122    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") pod \"maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:51.682448 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.682415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:51.940458 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:51.940361    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:52.079352 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:52.079321    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:02:52.081433 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:02:52.081409    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod902dd9ec_d12a_4d4e_a9e4_6ec6ebe13eb8.slice/crio-da0436b1874815b1ba06a746c647952272e9c32cf3b69500c2151678f3d2676a WatchSource:0}: Error finding container da0436b1874815b1ba06a746c647952272e9c32cf3b69500c2151678f3d2676a: Status 404 returned error can't find the container with id da0436b1874815b1ba06a746c647952272e9c32cf3b69500c2151678f3d2676a
Jul 29 05:02:53.031355 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:53.031315    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" event={"ID":"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8","Type":"ContainerStarted","Data":"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"}
Jul 29 05:02:53.031518 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:53.031374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" event={"ID":"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8","Type":"ContainerStarted","Data":"da0436b1874815b1ba06a746c647952272e9c32cf3b69500c2151678f3d2676a"}
Jul 29 05:02:53.031518 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:53.031397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:02:53.051470 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:53.051423    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" podStartSLOduration=1.5256067660000001 podStartE2EDuration="2.051407476s" totalImagesPullingTime="525.80071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:02:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:02:53.048921901 +0000 UTC m=+3563.323938703" watchObservedRunningTime="2026-07-29 05:02:53.051407476 +0000 UTC m=+3563.326424264"
Jul 29 05:02:57.059955 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:57.059921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:02:59.042305 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:02:59.042271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:03:09.123644 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.123609    2578 generic.go:356] "Generic (PLEG): container finished" podID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerID="ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22" exitCode=0
Jul 29 05:03:09.124141 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.123656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerDied","Data":"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"}
Jul 29 05:03:09.124141 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.124068    2578 scope.go:117] "RemoveContainer" containerID="ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"
Jul 29 05:03:09.125168 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.125125    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:09.125244 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.125204    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:09.125244 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:09.125234    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:10.135772 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:10.135712    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerStarted","Data":"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"}
Jul 29 05:03:10.251532 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:10.251490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:03:10.251792 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:10.251770    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 29 05:03:10.251914 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:10.251817    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 29 05:03:11.251126 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:11.251078    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 29 05:03:11.251555 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:11.251171    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 29 05:03:12.251030 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:12.250986    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 29 05:03:12.251246 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:12.251059    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 29 05:03:13.251560 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:13.251518    2578 patch_prober.go:28] interesting pod/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused" start-of-body=
Jul 29 05:03:13.252012 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:13.251580    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.82:15021/healthz/ready\": dial tcp 10.132.0.82:15021: connect: connection refused"
Jul 29 05:03:14.254829 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:14.254797    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:03:14.255237 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:14.255168    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:03:14.255878 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:14.255860    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:03:15.885014 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:15.884980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:16.546648 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.546616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:16.814881 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.814776    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:03:16.818060 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.818038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.821168 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.821148    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-b-b1dab2-openshift-default-dockercfg-z5czn\""
Jul 29 05:03:16.828918 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.828894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:03:16.857908 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.857872    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:16.911342 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.911308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.911979 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.911948    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912005    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kmvv\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912062    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912474 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912474 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:16.912474 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:16.912266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013169 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013128    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013169 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013271    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013298    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kmvv\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013348    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013910 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013618    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013910 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013646    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.013910 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.014080 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.013980    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.014242 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.014219    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.015722 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.015699    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.015895 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.015877    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.021985 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.021960    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kmvv\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.022080 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.021964    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token\") pod \"e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") " pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.130914 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.130820    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:17.232205 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.232164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:17.275533 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.275474    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:03:17.278315 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:03:17.278282    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2895a7c_0f93_4b65_b075_344281f03fe0.slice/crio-aad06b83e80a97cdc4e844bcaa21076c32079f982e219c1f4e60ca1d6d99016c WatchSource:0}: Error finding container aad06b83e80a97cdc4e844bcaa21076c32079f982e219c1f4e60ca1d6d99016c: Status 404 returned error can't find the container with id aad06b83e80a97cdc4e844bcaa21076c32079f982e219c1f4e60ca1d6d99016c
Jul 29 05:03:17.280675 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.280630    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:17.280815 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.280793    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:17.280887 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:17.280869    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:18.195851 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:18.195822    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerStarted","Data":"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"}
Jul 29 05:03:18.196236 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:18.195868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerStarted","Data":"aad06b83e80a97cdc4e844bcaa21076c32079f982e219c1f4e60ca1d6d99016c"}
Jul 29 05:03:18.214050 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:18.214002    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podStartSLOduration=2.213986283 podStartE2EDuration="2.213986283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:03:18.212175436 +0000 UTC m=+3588.487192248" watchObservedRunningTime="2026-07-29 05:03:18.213986283 +0000 UTC m=+3588.489003071"
Jul 29 05:03:19.131183 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:19.131143    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:19.136152 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:19.136114    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:19.201014 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:19.200989    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:19.201943 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:19.201926    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:20.092801 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.092765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.175358 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.175321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.177378 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.177349    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:03:20.180079 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.180058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.182664 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.182642    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-b-b1dab2-serving-cert\""
Jul 29 05:03:20.199095 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.199069    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:03:20.350138 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.350043    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2wrm8\" (UniqueName: \"kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.350138 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.350088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.350607 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.350388    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.424726 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.424654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.451473 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.451443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2wrm8\" (UniqueName: \"kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.451645 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.451490    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.451645 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.451616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.451795 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:03:20.451661    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-serving-cert: secret "maas-api-e2e-ipp-b-b1dab2-serving-cert" not found
Jul 29 05:03:20.451795 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:03:20.451759    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls podName:df304276-0af3-4f39-b081-a079191e87bd nodeName:}" failed. No retries permitted until 2026-07-29 05:03:20.951722657 +0000 UTC m=+3591.226739435 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls") pod "maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" (UID: "df304276-0af3-4f39-b081-a079191e87bd") : secret "maas-api-e2e-ipp-b-b1dab2-serving-cert" not found
Jul 29 05:03:20.452443 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.452418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.466141 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.466117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2wrm8\" (UniqueName: \"kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.523920 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.523887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.772896 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.772869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.924048 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.924016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:03:20.956325 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.956287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:20.958871 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:20.958852    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") pod \"maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:21.093665 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:21.093569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:21.239483 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:21.239454    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:03:21.241287 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:03:21.241261    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf304276_0af3_4f39_b081_a079191e87bd.slice/crio-6bbe2a549b9c69a219546c5dc94e37ef5e70522874dae741d4e478c1f48d08d2 WatchSource:0}: Error finding container 6bbe2a549b9c69a219546c5dc94e37ef5e70522874dae741d4e478c1f48d08d2: Status 404 returned error can't find the container with id 6bbe2a549b9c69a219546c5dc94e37ef5e70522874dae741d4e478c1f48d08d2
Jul 29 05:03:22.222618 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:22.222588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" event={"ID":"df304276-0af3-4f39-b081-a079191e87bd","Type":"ContainerStarted","Data":"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"}
Jul 29 05:03:22.223029 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:22.222634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" event={"ID":"df304276-0af3-4f39-b081-a079191e87bd","Type":"ContainerStarted","Data":"6bbe2a549b9c69a219546c5dc94e37ef5e70522874dae741d4e478c1f48d08d2"}
Jul 29 05:03:22.223029 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:22.222709    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:28.234303 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:28.234274    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:03:28.250995 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:28.250927    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" podStartSLOduration=7.878082444 podStartE2EDuration="8.25091265s" totalImagesPullingTime="372.830206ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:03:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:03:22.24115901 +0000 UTC m=+3592.516175808" watchObservedRunningTime="2026-07-29 05:03:28.25091265 +0000 UTC m=+3598.525929439"
Jul 29 05:03:30.464370 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:30.464342    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 05:03:30.495486 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:30.495463    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 05:03:38.323602 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.323570    2578 generic.go:356] "Generic (PLEG): container finished" podID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerID="e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740" exitCode=0
Jul 29 05:03:38.324063 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.323646    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerDied","Data":"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"}
Jul 29 05:03:38.324112 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.324091    2578 scope.go:117] "RemoveContainer" containerID="e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"
Jul 29 05:03:38.325184 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.325148    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:38.325303 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.325238    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:38.325303 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:38.325287    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:03:39.335772 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:39.335714    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerStarted","Data":"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"}
Jul 29 05:03:40.132288 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:40.132240    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:40.132508 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:40.132326    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 29 05:03:40.132508 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:40.132389    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 29 05:03:41.132267 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:41.132222    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 29 05:03:41.132929 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:41.132892    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 29 05:03:42.131485 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:42.131445    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 29 05:03:42.131817 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:42.131784    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 29 05:03:43.132327 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:43.132285    2578 patch_prober.go:28] interesting pod/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Jul 29 05:03:43.132964 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:43.132928    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Jul 29 05:03:44.134872 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:44.134837    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:44.135354 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:44.135191    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:44.135825 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:44.135805    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:03:45.070070 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:03:45.070018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:00.862876 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:00.862835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:31.449426 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:31.449388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:37.957232 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:37.957191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:49.729933 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:49.729893    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:50.134311 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.134271    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:04:50.136784 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.136741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.145385 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.145364    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-aa798b-openshift-default-dockercfg-g45gk\""
Jul 29 05:04:50.158125 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158288 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158288 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158310    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158415 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158365    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hklt6\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158522 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158418    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158522 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158618 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.158618 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.158596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.159515 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.159489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:04:50.226480 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.226421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:50.259215 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hklt6\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259435 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259435 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259574 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259823 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259823 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259814    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259990 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.259990 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.259955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260079    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260154 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260092    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260154 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260107    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260263 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260202    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260316 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.260550 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.260534    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.262285 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.262261    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.262470 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.262452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.275544 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.275520    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.276054 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.276030    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hklt6\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6\") pod \"e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") " pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.408809 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.408710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:50.446852 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.446822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:50.613361 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.613327    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:04:50.614348 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:04:50.614317    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82b4e5d7_0bf5_40b7_923c_2a3a70c205b0.slice/crio-7038aa24909924efd1e0113d2ba3676d85206316e635ab3526507cd666eab468 WatchSource:0}: Error finding container 7038aa24909924efd1e0113d2ba3676d85206316e635ab3526507cd666eab468: Status 404 returned error can't find the container with id 7038aa24909924efd1e0113d2ba3676d85206316e635ab3526507cd666eab468
Jul 29 05:04:50.616605 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.616564    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:04:50.616715 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.616650    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:04:50.616715 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.616695    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:04:50.755582 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.755547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerStarted","Data":"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"}
Jul 29 05:04:50.755988 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.755606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerStarted","Data":"7038aa24909924efd1e0113d2ba3676d85206316e635ab3526507cd666eab468"}
Jul 29 05:04:50.822346 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:50.822289    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podStartSLOduration=0.822271024 podStartE2EDuration="822.271024ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:04:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:04:50.818507381 +0000 UTC m=+3681.093524170" watchObservedRunningTime="2026-07-29 05:04:50.822271024 +0000 UTC m=+3681.097287871"
Jul 29 05:04:51.447594 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:51.447558    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:51.453838 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:51.453804    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:51.760821 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:51.760796    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:51.762169 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:51.762147    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:04:52.843432 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:52.843349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:52.968377 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:52.968339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:53.074493 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:53.074462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:53.219198 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:53.219110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:53.770785 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:53.770733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:04:54.227615 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:04:54.227525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:11.891441 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.891356    2578 generic.go:356] "Generic (PLEG): container finished" podID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerID="be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303" exitCode=0
Jul 29 05:05:11.891441 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.891430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerDied","Data":"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"}
Jul 29 05:05:11.891925 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.891863    2578 scope.go:117] "RemoveContainer" containerID="be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"
Jul 29 05:05:11.893002 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.892972    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:05:11.893118 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.893059    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:05:11.893184 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:11.893127    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236224Ki","pods":"250"}
Jul 29 05:05:12.899410 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:12.899378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerStarted","Data":"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"}
Jul 29 05:05:13.448269 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:13.448220    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:13.448492 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:13.448362    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 29 05:05:13.448492 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:13.448407    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 29 05:05:14.447918 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:14.447877    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 29 05:05:14.448562 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:14.448522    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 29 05:05:15.447520 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:15.447472    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 29 05:05:15.447734 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:15.447544    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 29 05:05:16.447405 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:16.447358    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused" start-of-body=
Jul 29 05:05:16.447930 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:16.447431    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.86:15021/healthz/ready\": dial tcp 10.132.0.86:15021: connect: connection refused"
Jul 29 05:05:17.461258 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:17.461225    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:17.461713 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:17.461615    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:17.462475 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:17.462448    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:17.866060 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:17.866024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:24.047432 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:24.047393    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:24.249502 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:24.249468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:24.442576 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:24.442458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:24.602044 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:24.602014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:25.349379 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:25.349346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:31.580161 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:31.580124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:31.731447 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:31.731412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:31.966389 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:31.966299    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:05:31.966575 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:31.966525    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" containerID="cri-o://0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec" gracePeriod=30
Jul 29 05:05:32.003479 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:32.003445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:32.184636 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:32.184606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:32.463903 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:32.463862    2578 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 29 05:05:32.464082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:32.463918    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 29 05:05:37.220630 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.220605    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:37.345615 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.345615 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.345901 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345653    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.345901 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.345901 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345777    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hklt6\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.345901 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.346123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345915    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.346123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.345972    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.346123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy\") pod \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\" (UID: \"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0\") "
Jul 29 05:05:37.346123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346040    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:05:37.346339 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346130    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:37.346339 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346156    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:05:37.346339 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346282    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:05:37.346879 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346580    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.346879 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346606    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.346879 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346622    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.346879 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346623    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:05:37.346879 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.346636    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.348094 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.348060    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:05:37.348200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.348119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6" (OuterVolumeSpecName: "kube-api-access-hklt6") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "kube-api-access-hklt6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:05:37.348248 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.348198    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:05:37.348538 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.348516    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" (UID: "82b4e5d7-0bf5-40b7-923c-2a3a70c205b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:05:37.447965 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.447924    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.447965 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.447960    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.447965 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.447972    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.448199 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.447983    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:37.448199 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:37.447994    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hklt6\" (UniqueName: \"kubernetes.io/projected/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0-kube-api-access-hklt6\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:38.051019 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.050978    2578 generic.go:356] "Generic (PLEG): container finished" podID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerID="0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec" exitCode=0
Jul 29 05:05:38.051220 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.051043    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"
Jul 29 05:05:38.051220 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.051067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerDied","Data":"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"}
Jul 29 05:05:38.051220 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.051153    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242" event={"ID":"82b4e5d7-0bf5-40b7-923c-2a3a70c205b0","Type":"ContainerDied","Data":"7038aa24909924efd1e0113d2ba3676d85206316e635ab3526507cd666eab468"}
Jul 29 05:05:38.051220 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.051178    2578 scope.go:117] "RemoveContainer" containerID="0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"
Jul 29 05:05:38.061523 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.061504    2578 scope.go:117] "RemoveContainer" containerID="be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"
Jul 29 05:05:38.070310 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.070287    2578 scope.go:117] "RemoveContainer" containerID="0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"
Jul 29 05:05:38.070567 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:05:38.070548    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec\": container with ID starting with 0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec not found: ID does not exist" containerID="0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"
Jul 29 05:05:38.070613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.070576    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec"} err="failed to get container status \"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec\": rpc error: code = NotFound desc = could not find container \"0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec\": container with ID starting with 0bf716c1f93271de9db02f4ed1b752d6fa9fe5c8a01120fa183ed1f59dbb76ec not found: ID does not exist"
Jul 29 05:05:38.070613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.070595    2578 scope.go:117] "RemoveContainer" containerID="be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"
Jul 29 05:05:38.070957 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:05:38.070937    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303\": container with ID starting with be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303 not found: ID does not exist" containerID="be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"
Jul 29 05:05:38.071043 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.070963    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303"} err="failed to get container status \"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303\": rpc error: code = NotFound desc = could not find container \"be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303\": container with ID starting with be8adc7575ca8890a3845b73af18598acad249c74a5ebc4109a2ea80bfc57303 not found: ID does not exist"
Jul 29 05:05:38.075101 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.075079    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:05:38.077543 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.077522    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-aa798b-openshift-default-5f96d4cf64-dr242"]
Jul 29 05:05:38.196340 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:38.196303    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" path="/var/lib/kubelet/pods/82b4e5d7-0bf5-40b7-923c-2a3a70c205b0/volumes"
Jul 29 05:05:51.068403 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.068362    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:05:51.069005 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.068585    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" podUID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" containerName="maas-api" containerID="cri-o://14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150" gracePeriod=30
Jul 29 05:05:51.117634 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.117600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:51.200396 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.200369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:51.316333 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.316299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:51.350232 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.350207    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:05:51.386627 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.386589    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca\") pod \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") "
Jul 29 05:05:51.386627 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.386631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-495r9\" (UniqueName: \"kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9\") pod \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") "
Jul 29 05:05:51.386928 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.386660    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") pod \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\" (UID: \"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8\") "
Jul 29 05:05:51.387046 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.387022    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" (UID: "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:05:51.388941 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.388907    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" (UID: "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:05:51.389082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.389061    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9" (OuterVolumeSpecName: "kube-api-access-495r9") pod "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" (UID: "902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8"). InnerVolumeSpecName "kube-api-access-495r9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:05:51.487624 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.487586    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:51.487624 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.487620    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-495r9\" (UniqueName: \"kubernetes.io/projected/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-kube-api-access-495r9\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:51.487873 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.487634    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:05:51.743483 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:51.743397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:05:52.133863 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.133827    2578 generic.go:356] "Generic (PLEG): container finished" podID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" containerID="14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150" exitCode=0
Jul 29 05:05:52.134301 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.133874    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"
Jul 29 05:05:52.134301 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.133919    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" event={"ID":"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8","Type":"ContainerDied","Data":"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"}
Jul 29 05:05:52.134301 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.133970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq" event={"ID":"902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8","Type":"ContainerDied","Data":"da0436b1874815b1ba06a746c647952272e9c32cf3b69500c2151678f3d2676a"}
Jul 29 05:05:52.134301 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.133992    2578 scope.go:117] "RemoveContainer" containerID="14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"
Jul 29 05:05:52.144366 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.144348    2578 scope.go:117] "RemoveContainer" containerID="14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"
Jul 29 05:05:52.144643 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:05:52.144625    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150\": container with ID starting with 14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150 not found: ID does not exist" containerID="14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"
Jul 29 05:05:52.144693 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.144650    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150"} err="failed to get container status \"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150\": rpc error: code = NotFound desc = could not find container \"14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150\": container with ID starting with 14d957fa126c1ae2a900c094c77dc517beb2937c73779cbd101844a555801150 not found: ID does not exist"
Jul 29 05:05:52.184268 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.184222    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:05:52.198766 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:52.198725    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-a-c210b8-844dbc7856-65tvq"]
Jul 29 05:05:54.196227 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:54.196188    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" path="/var/lib/kubelet/pods/902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8/volumes"
Jul 29 05:05:56.758381 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:05:56.758345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:16.314406 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:16.314367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:16.391613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:16.391582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:33.538123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:33.538088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:33.978335 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:33.978249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:39.578998 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:39.578953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:45.391011 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.390976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:45.464000 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.463957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:45.670026 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.669948    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:06:45.670196 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.670172    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy" containerID="cri-o://709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0" gracePeriod=30
Jul 29 05:06:45.687887 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.687857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:45.936851 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:45.936695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:50.929102 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:50.929035    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:06:51.072955 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.072919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqdcr\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073088    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073155 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073130    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073347 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073173    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073347 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073201    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073347 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073347 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073260    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data\") pod \"995b377e-9998-4a98-a3d4-d11b9226dac5\" (UID: \"995b377e-9998-4a98-a3d4-d11b9226dac5\") "
Jul 29 05:06:51.073613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073425    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:51.073673 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073652    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.073729 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073684    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:06:51.073922 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073809    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:51.073922 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.073881    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:51.074260 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.074236    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data" (OuterVolumeSpecName: "istio-data") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:51.075437 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.075407    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:06:51.075545 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.075470    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token" (OuterVolumeSpecName: "istio-token") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:06:51.075602 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.075583    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr" (OuterVolumeSpecName: "kube-api-access-jqdcr") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "kube-api-access-jqdcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:06:51.075657 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.075637    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "995b377e-9998-4a98-a3d4-d11b9226dac5" (UID: "995b377e-9998-4a98-a3d4-d11b9226dac5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:06:51.174854 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174814    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.174854 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174846    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.174854 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174855    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/995b377e-9998-4a98-a3d4-d11b9226dac5-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.174854 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174865    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.175146 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174873    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.175146 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174883    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.175146 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174891    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/995b377e-9998-4a98-a3d4-d11b9226dac5-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.175146 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.174899    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqdcr\" (UniqueName: \"kubernetes.io/projected/995b377e-9998-4a98-a3d4-d11b9226dac5-kube-api-access-jqdcr\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:51.497920 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.497885    2578 generic.go:356] "Generic (PLEG): container finished" podID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerID="709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0" exitCode=0
Jul 29 05:06:51.498135 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.497935    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"
Jul 29 05:06:51.498135 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.497977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerDied","Data":"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"}
Jul 29 05:06:51.498135 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.498038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf" event={"ID":"995b377e-9998-4a98-a3d4-d11b9226dac5","Type":"ContainerDied","Data":"fab8dc230072bd1f3b659982c81b68ed1804d17c910a4fcf694f792628effb2a"}
Jul 29 05:06:51.498135 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.498066    2578 scope.go:117] "RemoveContainer" containerID="709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"
Jul 29 05:06:51.508773 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.508738    2578 scope.go:117] "RemoveContainer" containerID="ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"
Jul 29 05:06:51.518178 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.518154    2578 scope.go:117] "RemoveContainer" containerID="709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"
Jul 29 05:06:51.518575 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:06:51.518533    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0\": container with ID starting with 709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0 not found: ID does not exist" containerID="709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"
Jul 29 05:06:51.518701 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.518575    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0"} err="failed to get container status \"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0\": rpc error: code = NotFound desc = could not find container \"709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0\": container with ID starting with 709289fb7a540163c61e62f3f3f5db22b51b86b64621100310f79925f06cdeb0 not found: ID does not exist"
Jul 29 05:06:51.518701 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.518620    2578 scope.go:117] "RemoveContainer" containerID="ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"
Jul 29 05:06:51.519047 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:06:51.518982    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22\": container with ID starting with ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22 not found: ID does not exist" containerID="ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"
Jul 29 05:06:51.519047 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.519016    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22"} err="failed to get container status \"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22\": rpc error: code = NotFound desc = could not find container \"ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22\": container with ID starting with ddda6bc64c0f8b11d1e6d57e9dc4d0936fca9f1bd1d81ac0174f9899744c3e22 not found: ID does not exist"
Jul 29 05:06:51.521822 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.521801    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:06:51.526223 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:51.526201    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-c210b8-openshift-default-68fdf4bc4b-jn2wf"]
Jul 29 05:06:52.195934 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:52.195899    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" path="/var/lib/kubelet/pods/995b377e-9998-4a98-a3d4-d11b9226dac5/volumes"
Jul 29 05:06:56.507820 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.507779    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:06:56.508298 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.507983    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" podUID="df304276-0af3-4f39-b081-a079191e87bd" containerName="maas-api" containerID="cri-o://2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5" gracePeriod=30
Jul 29 05:06:56.538676 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.538651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:56.639977 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.639947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:56.717357 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.717326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:56.770933 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.770910    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:06:56.774492 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.774438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:56.932097 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.932057    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca\") pod \"df304276-0af3-4f39-b081-a079191e87bd\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") "
Jul 29 05:06:56.932308 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.932117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2wrm8\" (UniqueName: \"kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8\") pod \"df304276-0af3-4f39-b081-a079191e87bd\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") "
Jul 29 05:06:56.932308 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.932175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") pod \"df304276-0af3-4f39-b081-a079191e87bd\" (UID: \"df304276-0af3-4f39-b081-a079191e87bd\") "
Jul 29 05:06:56.932466 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.932441    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "df304276-0af3-4f39-b081-a079191e87bd" (UID: "df304276-0af3-4f39-b081-a079191e87bd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:06:56.932572 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.932558    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/df304276-0af3-4f39-b081-a079191e87bd-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:56.934418 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.934395    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8" (OuterVolumeSpecName: "kube-api-access-2wrm8") pod "df304276-0af3-4f39-b081-a079191e87bd" (UID: "df304276-0af3-4f39-b081-a079191e87bd"). InnerVolumeSpecName "kube-api-access-2wrm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:06:56.934418 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:56.934399    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "df304276-0af3-4f39-b081-a079191e87bd" (UID: "df304276-0af3-4f39-b081-a079191e87bd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:06:57.033486 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.033394    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2wrm8\" (UniqueName: \"kubernetes.io/projected/df304276-0af3-4f39-b081-a079191e87bd-kube-api-access-2wrm8\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:57.033486 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.033426    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/df304276-0af3-4f39-b081-a079191e87bd-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:06:57.110298 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.110266    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:06:57.537427 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.537394    2578 generic.go:356] "Generic (PLEG): container finished" podID="df304276-0af3-4f39-b081-a079191e87bd" containerID="2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5" exitCode=0
Jul 29 05:06:57.537950 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.537446    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"
Jul 29 05:06:57.537950 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.537477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" event={"ID":"df304276-0af3-4f39-b081-a079191e87bd","Type":"ContainerDied","Data":"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"}
Jul 29 05:06:57.537950 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.537538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b" event={"ID":"df304276-0af3-4f39-b081-a079191e87bd","Type":"ContainerDied","Data":"6bbe2a549b9c69a219546c5dc94e37ef5e70522874dae741d4e478c1f48d08d2"}
Jul 29 05:06:57.537950 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.537566    2578 scope.go:117] "RemoveContainer" containerID="2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"
Jul 29 05:06:57.547264 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.547248    2578 scope.go:117] "RemoveContainer" containerID="2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"
Jul 29 05:06:57.547516 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:06:57.547499    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5\": container with ID starting with 2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5 not found: ID does not exist" containerID="2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"
Jul 29 05:06:57.547554 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.547526    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5"} err="failed to get container status \"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5\": rpc error: code = NotFound desc = could not find container \"2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5\": container with ID starting with 2d8b477b060ae4b4168237684bce99e78b8b84e1d051171480a57f78bb017fb5 not found: ID does not exist"
Jul 29 05:06:57.560609 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.560582    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:06:57.568111 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:57.568079    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-b-b1dab2-757d456f99-7ms2b"]
Jul 29 05:06:58.196407 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:06:58.196369    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df304276-0af3-4f39-b081-a079191e87bd" path="/var/lib/kubelet/pods/df304276-0af3-4f39-b081-a079191e87bd/volumes"
Jul 29 05:07:02.855880 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:02.855847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:02.924183 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:02.924137    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:03.096090 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:03.096056    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:07:03.096310 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:03.096278    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy" containerID="cri-o://fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46" gracePeriod=30
Jul 29 05:07:03.128123 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:03.128031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:03.352082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:03.352043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:08.337877 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.337847    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:07:08.430906 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.430821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.430906 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.430882    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.430919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.430948    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.430986    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2kmvv\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431043    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431069    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431365 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431107    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431365 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431119    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:08.431365 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431228    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert\") pod \"f2895a7c-0f93-4b65-b075-344281f03fe0\" (UID: \"f2895a7c-0f93-4b65-b075-344281f03fe0\") "
Jul 29 05:07:08.431365 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431233    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:08.431365 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431245    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:08.431642 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431571    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.431642 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431591    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.431642 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431607    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.431818 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431657    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:08.431981 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.431957    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data" (OuterVolumeSpecName: "istio-data") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:08.433224 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.433199    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token" (OuterVolumeSpecName: "istio-token") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:08.433224 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.433218    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:07:08.433590 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.433563    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv" (OuterVolumeSpecName: "kube-api-access-2kmvv") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "kube-api-access-2kmvv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:08.433590 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.433571    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f2895a7c-0f93-4b65-b075-344281f03fe0" (UID: "f2895a7c-0f93-4b65-b075-344281f03fe0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:08.532145 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532116    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.532145 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532141    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.532145 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532151    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.532363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532159    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f2895a7c-0f93-4b65-b075-344281f03fe0-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.532363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532167    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f2895a7c-0f93-4b65-b075-344281f03fe0-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.532363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.532175    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2kmvv\" (UniqueName: \"kubernetes.io/projected/f2895a7c-0f93-4b65-b075-344281f03fe0-kube-api-access-2kmvv\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:08.601522 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.601489    2578 generic.go:356] "Generic (PLEG): container finished" podID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerID="fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46" exitCode=0
Jul 29 05:07:08.601682 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.601542    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"
Jul 29 05:07:08.601682 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.601574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerDied","Data":"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"}
Jul 29 05:07:08.601682 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.601634    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6" event={"ID":"f2895a7c-0f93-4b65-b075-344281f03fe0","Type":"ContainerDied","Data":"aad06b83e80a97cdc4e844bcaa21076c32079f982e219c1f4e60ca1d6d99016c"}
Jul 29 05:07:08.601682 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.601659    2578 scope.go:117] "RemoveContainer" containerID="fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"
Jul 29 05:07:08.611048 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.611023    2578 scope.go:117] "RemoveContainer" containerID="e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"
Jul 29 05:07:08.619162 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.619143    2578 scope.go:117] "RemoveContainer" containerID="fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"
Jul 29 05:07:08.619381 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:08.619362    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46\": container with ID starting with fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46 not found: ID does not exist" containerID="fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"
Jul 29 05:07:08.619431 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.619388    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46"} err="failed to get container status \"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46\": rpc error: code = NotFound desc = could not find container \"fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46\": container with ID starting with fe751413c3a176fa201672af6f9bafbd2caebb9bcb24a13d8951c75a449eba46 not found: ID does not exist"
Jul 29 05:07:08.619431 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.619404    2578 scope.go:117] "RemoveContainer" containerID="e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"
Jul 29 05:07:08.619599 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:08.619584    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740\": container with ID starting with e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740 not found: ID does not exist" containerID="e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"
Jul 29 05:07:08.619639 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.619601    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740"} err="failed to get container status \"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740\": rpc error: code = NotFound desc = could not find container \"e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740\": container with ID starting with e0cb7377d3e8d1bd94ebeccee560e5c0e1f4b6e0a2d1aa4bdf892e1443857740 not found: ID does not exist"
Jul 29 05:07:08.625221 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.625200    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:07:08.629523 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.629502    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-b-b1dab2-openshift-default-f98489bc6-hj8k6"]
Jul 29 05:07:08.690138 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.690067    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 05:07:08.690358 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.690331    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" podUID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" containerName="maas-api" containerID="cri-o://a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c" gracePeriod=30
Jul 29 05:07:08.720440 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.720411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:08.793852 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.793814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:08.857982 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.857951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:08.927291 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.927247    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:08.931846 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:08.931823    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 05:07:09.036290 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.036267    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8djkd\" (UniqueName: \"kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd\") pod \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") "
Jul 29 05:07:09.036480 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.036327    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca\") pod \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") "
Jul 29 05:07:09.036480 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.036353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls\") pod \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\" (UID: \"f4f1c02b-f789-477a-8f79-26259c5f3ff5\") "
Jul 29 05:07:09.036707 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.036684    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f4f1c02b-f789-477a-8f79-26259c5f3ff5" (UID: "f4f1c02b-f789-477a-8f79-26259c5f3ff5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:09.038416 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.038391    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f4f1c02b-f789-477a-8f79-26259c5f3ff5" (UID: "f4f1c02b-f789-477a-8f79-26259c5f3ff5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:07:09.038504 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.038455    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd" (OuterVolumeSpecName: "kube-api-access-8djkd") pod "f4f1c02b-f789-477a-8f79-26259c5f3ff5" (UID: "f4f1c02b-f789-477a-8f79-26259c5f3ff5"). InnerVolumeSpecName "kube-api-access-8djkd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:09.137037 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.137008    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8djkd\" (UniqueName: \"kubernetes.io/projected/f4f1c02b-f789-477a-8f79-26259c5f3ff5-kube-api-access-8djkd\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:09.137037 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.137036    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4f1c02b-f789-477a-8f79-26259c5f3ff5-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:09.137186 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.137050    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f4f1c02b-f789-477a-8f79-26259c5f3ff5-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:09.249321 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.249295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:09.608279 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.608247    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" containerID="a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c" exitCode=0
Jul 29 05:07:09.608732 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.608295    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"
Jul 29 05:07:09.608732 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.608334    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" event={"ID":"f4f1c02b-f789-477a-8f79-26259c5f3ff5","Type":"ContainerDied","Data":"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"}
Jul 29 05:07:09.608732 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.608389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6" event={"ID":"f4f1c02b-f789-477a-8f79-26259c5f3ff5","Type":"ContainerDied","Data":"3756f96488fc94b72f68dba091c8c911acf8de2ed30d608a94b52ba702640ea6"}
Jul 29 05:07:09.608732 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.608414    2578 scope.go:117] "RemoveContainer" containerID="a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"
Jul 29 05:07:09.617933 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.617916    2578 scope.go:117] "RemoveContainer" containerID="a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"
Jul 29 05:07:09.618186 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:09.618169    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c\": container with ID starting with a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c not found: ID does not exist" containerID="a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"
Jul 29 05:07:09.618231 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.618193    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c"} err="failed to get container status \"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c\": rpc error: code = NotFound desc = could not find container \"a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c\": container with ID starting with a2e3498d741e3a1845209ceed041658a763d9e04329564b9cfa32ee393c4ac5c not found: ID does not exist"
Jul 29 05:07:09.639383 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.639362    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 05:07:09.645886 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:09.645865    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-6eef04-5fb94c9f94-b7jc6"]
Jul 29 05:07:10.195388 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:10.195354    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" path="/var/lib/kubelet/pods/f2895a7c-0f93-4b65-b075-344281f03fe0/volumes"
Jul 29 05:07:10.195822 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:10.195809    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" path="/var/lib/kubelet/pods/f4f1c02b-f789-477a-8f79-26259c5f3ff5/volumes"
Jul 29 05:07:15.362358 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.362322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:15.471152 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.471113    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:15.622392 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.622301    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 05:07:15.622542 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.622521    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy" containerID="cri-o://4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8" gracePeriod=30
Jul 29 05:07:15.648193 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.648152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:15.910348 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:15.910255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:20.893068 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.893007    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 05:07:20.942808 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942767    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.942981 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942835    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rw9ln\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.942981 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942865    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.942981 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942908    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.942981 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942950    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.943200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.942997    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.943200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943064    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.943200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943129    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.943200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943161    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data\") pod \"f89d9001-a18e-4b38-8ef9-accf63814ac6\" (UID: \"f89d9001-a18e-4b38-8ef9-accf63814ac6\") "
Jul 29 05:07:20.943200 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943167    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:20.943446 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943257    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:20.943446 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943410    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:20.943446 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943412    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:20.943616 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943513    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:20.943616 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943532    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:20.943616 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.943546    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:20.944125 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.944103    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data" (OuterVolumeSpecName: "istio-data") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:20.945105 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.945080    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln" (OuterVolumeSpecName: "kube-api-access-rw9ln") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "kube-api-access-rw9ln". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:20.945561 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.945532    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:07:20.945634 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.945616    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token" (OuterVolumeSpecName: "istio-token") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:20.945673 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:20.945623    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f89d9001-a18e-4b38-8ef9-accf63814ac6" (UID: "f89d9001-a18e-4b38-8ef9-accf63814ac6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:21.044082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044052    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f89d9001-a18e-4b38-8ef9-accf63814ac6-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.044082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044078    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.044082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044087    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.044281 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044094    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.044281 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044103    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rw9ln\" (UniqueName: \"kubernetes.io/projected/f89d9001-a18e-4b38-8ef9-accf63814ac6-kube-api-access-rw9ln\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.044281 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.044113    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f89d9001-a18e-4b38-8ef9-accf63814ac6-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:21.674955 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.674915    2578 generic.go:356] "Generic (PLEG): container finished" podID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerID="4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8" exitCode=0
Jul 29 05:07:21.675131 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.674965    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"
Jul 29 05:07:21.675131 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.674973    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerDied","Data":"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"}
Jul 29 05:07:21.675131 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.675023    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5" event={"ID":"f89d9001-a18e-4b38-8ef9-accf63814ac6","Type":"ContainerDied","Data":"6144eb225235d9b02df63b5916b7c6eb101895e45c3330804c993ad1ab1976fd"}
Jul 29 05:07:21.675131 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.675047    2578 scope.go:117] "RemoveContainer" containerID="4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"
Jul 29 05:07:21.685620 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.685606    2578 scope.go:117] "RemoveContainer" containerID="7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"
Jul 29 05:07:21.695102 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.695088    2578 scope.go:117] "RemoveContainer" containerID="4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"
Jul 29 05:07:21.695384 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:21.695363    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8\": container with ID starting with 4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8 not found: ID does not exist" containerID="4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"
Jul 29 05:07:21.695452 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.695392    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8"} err="failed to get container status \"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8\": rpc error: code = NotFound desc = could not find container \"4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8\": container with ID starting with 4c8813024ef8d32d8a32f088118ba1a37a94b56b3306319a19d1ad6d4f2ebcf8 not found: ID does not exist"
Jul 29 05:07:21.695452 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.695415    2578 scope.go:117] "RemoveContainer" containerID="7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"
Jul 29 05:07:21.695637 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:21.695620    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379\": container with ID starting with 7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379 not found: ID does not exist" containerID="7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"
Jul 29 05:07:21.695700 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.695639    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379"} err="failed to get container status \"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379\": rpc error: code = NotFound desc = could not find container \"7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379\": container with ID starting with 7f38ede16058462bb5fecc3cd941b384fbc7a9fd9ab20551955c6868fa2c1379 not found: ID does not exist"
Jul 29 05:07:21.705247 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.705225    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 05:07:21.714290 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:21.714267    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-6eef04-openshift-default-b66f54796-rtnm5"]
Jul 29 05:07:22.195427 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:22.195388    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" path="/var/lib/kubelet/pods/f89d9001-a18e-4b38-8ef9-accf63814ac6/volumes"
Jul 29 05:07:26.526916 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.526883    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 05:07:26.527339 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.527079    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" podUID="eda5bff9-904f-4553-9fc9-064638eaa41b" containerName="maas-api" containerID="cri-o://382efc1ee76ce402f402c6ff9588f1607bfb728db1ad7cfa8c9de23378e2f5c0" gracePeriod=30
Jul 29 05:07:26.561030 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.560999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:26.706618 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.706593    2578 generic.go:356] "Generic (PLEG): container finished" podID="eda5bff9-904f-4553-9fc9-064638eaa41b" containerID="382efc1ee76ce402f402c6ff9588f1607bfb728db1ad7cfa8c9de23378e2f5c0" exitCode=0
Jul 29 05:07:26.706782 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.706672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" event={"ID":"eda5bff9-904f-4553-9fc9-064638eaa41b","Type":"ContainerDied","Data":"382efc1ee76ce402f402c6ff9588f1607bfb728db1ad7cfa8c9de23378e2f5c0"}
Jul 29 05:07:26.735224 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.735173    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:26.784008 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.783946    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 05:07:26.895370 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.895324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttqwx\" (UniqueName: \"kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx\") pod \"eda5bff9-904f-4553-9fc9-064638eaa41b\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") "
Jul 29 05:07:26.895740 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.895418    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca\") pod \"eda5bff9-904f-4553-9fc9-064638eaa41b\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") "
Jul 29 05:07:26.895740 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.895562    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") pod \"eda5bff9-904f-4553-9fc9-064638eaa41b\" (UID: \"eda5bff9-904f-4553-9fc9-064638eaa41b\") "
Jul 29 05:07:26.895989 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.895733    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "eda5bff9-904f-4553-9fc9-064638eaa41b" (UID: "eda5bff9-904f-4553-9fc9-064638eaa41b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:26.895989 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.895901    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/eda5bff9-904f-4553-9fc9-064638eaa41b-openshift-service-ca\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:26.897553 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.897519    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx" (OuterVolumeSpecName: "kube-api-access-ttqwx") pod "eda5bff9-904f-4553-9fc9-064638eaa41b" (UID: "eda5bff9-904f-4553-9fc9-064638eaa41b"). InnerVolumeSpecName "kube-api-access-ttqwx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:26.897672 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.897629    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "eda5bff9-904f-4553-9fc9-064638eaa41b" (UID: "eda5bff9-904f-4553-9fc9-064638eaa41b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 29 05:07:26.921115 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.921088    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:26.997211 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.997191    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/eda5bff9-904f-4553-9fc9-064638eaa41b-maas-api-tls\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:26.997211 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:26.997213    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttqwx\" (UniqueName: \"kubernetes.io/projected/eda5bff9-904f-4553-9fc9-064638eaa41b-kube-api-access-ttqwx\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:27.026989 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.026967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:27.317866 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.317834    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:27.717302 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.717219    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"
Jul 29 05:07:27.717742 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.717218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp" event={"ID":"eda5bff9-904f-4553-9fc9-064638eaa41b","Type":"ContainerDied","Data":"82409a6828ecbd315edea5386dda72dbc2d5d71acc3bf7f7d2ca695596c0ce1a"}
Jul 29 05:07:27.717742 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.717356    2578 scope.go:117] "RemoveContainer" containerID="382efc1ee76ce402f402c6ff9588f1607bfb728db1ad7cfa8c9de23378e2f5c0"
Jul 29 05:07:27.741364 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.741338    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 05:07:27.747670 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:27.747645    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-be8bc5-696958cb9b-ww4cp"]
Jul 29 05:07:28.195419 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:28.195391    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eda5bff9-904f-4553-9fc9-064638eaa41b" path="/var/lib/kubelet/pods/eda5bff9-904f-4553-9fc9-064638eaa41b/volumes"
Jul 29 05:07:33.507061 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:33.507027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:33.740084 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:33.740054    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 05:07:33.740281 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:33.740256    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy" containerID="cri-o://710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68" gracePeriod=30
Jul 29 05:07:35.026021 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:35.025981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:38.996977 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:38.996956    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 05:07:39.099626 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099590    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.099626 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099631    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.099848 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099649    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.099848 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099673    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.099848 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099719    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.099848 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099787    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.100049 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099852    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7h52r\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.100049 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099892    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.100049 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099892    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:39.100049 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.099958    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs\") pod \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\" (UID: \"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3\") "
Jul 29 05:07:39.100274 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100083    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 29 05:07:39.100411 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100359    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.100411 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100386    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istiod-ca-cert\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.100587 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100415    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:39.100587 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100475    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:39.100733 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.100706    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:39.101912 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.101886    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:39.102012 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.101964    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 29 05:07:39.102082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.102023    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 29 05:07:39.102082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.102029    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r" (OuterVolumeSpecName: "kube-api-access-7h52r") pod "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" (UID: "6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3"). InnerVolumeSpecName "kube-api-access-7h52r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 29 05:07:39.201802 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201768    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-workload-certs\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201802 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201803    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-token\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201802 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201812    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-data\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201967 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201820    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-podinfo\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201967 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201828    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-istio-envoy\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201967 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201837    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7h52r\" (UniqueName: \"kubernetes.io/projected/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-kube-api-access-7h52r\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.201967 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.201845    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3-credential-socket\") on node \"ip-10-0-129-12.ec2.internal\" DevicePath \"\""
Jul 29 05:07:39.785082 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.785049    2578 generic.go:356] "Generic (PLEG): container finished" podID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerID="710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68" exitCode=0
Jul 29 05:07:39.785289 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.785100    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"
Jul 29 05:07:39.785289 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.785133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerDied","Data":"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"}
Jul 29 05:07:39.785289 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.785200    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk" event={"ID":"6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3","Type":"ContainerDied","Data":"724dd3052f997e7ece0c78c771e2e3be982643cd825075f8bc5ff1a988f26d7b"}
Jul 29 05:07:39.785289 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.785234    2578 scope.go:117] "RemoveContainer" containerID="710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"
Jul 29 05:07:39.795425 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.795405    2578 scope.go:117] "RemoveContainer" containerID="f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"
Jul 29 05:07:39.806595 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.806579    2578 scope.go:117] "RemoveContainer" containerID="710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"
Jul 29 05:07:39.806996 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:39.806900    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68\": container with ID starting with 710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68 not found: ID does not exist" containerID="710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"
Jul 29 05:07:39.806996 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.806934    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68"} err="failed to get container status \"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68\": rpc error: code = NotFound desc = could not find container \"710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68\": container with ID starting with 710318649dca0ad8fe6f34d9e4c8bc186f291341046f9eb3daf8c4d13d927f68 not found: ID does not exist"
Jul 29 05:07:39.806996 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.806954    2578 scope.go:117] "RemoveContainer" containerID="f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"
Jul 29 05:07:39.807657 ip-10-0-129-12 kubenswrapper[2578]: E0729 05:07:39.807629    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d\": container with ID starting with f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d not found: ID does not exist" containerID="f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"
Jul 29 05:07:39.807786 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.807662    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d"} err="failed to get container status \"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d\": rpc error: code = NotFound desc = could not find container \"f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d\": container with ID starting with f96823623e0c9dafda3d181a68e74710d93fa218238ad07ac5585a18b9394c3d not found: ID does not exist"
Jul 29 05:07:39.810515 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.810492    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 05:07:39.833876 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:39.833852    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-be8bc5-openshift-default-8669bb5f8d-vbdfk"]
Jul 29 05:07:40.201011 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:40.200926    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" path="/var/lib/kubelet/pods/6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3/volumes"
Jul 29 05:07:40.483258 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:40.483180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-fsgkm_937aba2e-d65b-4f31-bd6f-54df96944bd1/copy-manifests/0.log"
Jul 29 05:07:40.496141 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:40.496109    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-fsgkm_937aba2e-d65b-4f31-bd6f-54df96944bd1/manager/0.log"
Jul 29 05:07:41.194060 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:41.194029    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29754990-mj989_5e5b1e17-3047-406e-99c1-b16b725ae76c/cleanup/0.log"
Jul 29 05:07:41.306944 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:41.306911    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29755005-m9qlb_106d0a0c-aa39-4506-9b95-d3e5baedff63/cleanup/0.log"
Jul 29 05:07:42.288181 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.288151    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/extract/0.log"
Jul 29 05:07:42.294724 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.294703    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/util/0.log"
Jul 29 05:07:42.301588 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.301567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/pull/0.log"
Jul 29 05:07:42.423135 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.423113    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/extract/0.log"
Jul 29 05:07:42.435660 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.435641    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/util/0.log"
Jul 29 05:07:42.446682 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.446662    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/pull/0.log"
Jul 29 05:07:42.553029 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.552968    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/util/0.log"
Jul 29 05:07:42.560876 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.560838    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/pull/0.log"
Jul 29 05:07:42.567240 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.567221    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/extract/0.log"
Jul 29 05:07:42.678735 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.678714    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/util/0.log"
Jul 29 05:07:42.686899 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.686876    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/pull/0.log"
Jul 29 05:07:42.694887 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:42.694865    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/extract/0.log"
Jul 29 05:07:44.065201 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:44.065163    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-77l94_43ab3d0a-232f-45bb-93bb-cf20d244bf25/discovery/0.log"
Jul 29 05:07:44.517093 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:44.517065    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bdfv5_8ca0fb86-f420-491c-b4d3-d8d7f706f896/payload-pre-processing/0.log"
Jul 29 05:07:44.735908 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:44.735873    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fb4f4744f-ltrx6_36a75980-e622-410c-973f-a21cb2a908c4/router/0.log"
Jul 29 05:07:45.058965 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:45.058936    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-rz2lb_aefe3072-0205-4cb4-a406-bbf5242da49b/main/0.log"
Jul 29 05:07:45.496250 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:45.496171    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-pf4lk_b9c4c317-6974-476c-8a01-3a2e3fb4319d/main/0.log"
Jul 29 05:07:51.018604 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018569    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld4p/must-gather-rs6pp"]
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018917    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" containerName="maas-api"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018929    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" containerName="maas-api"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018942    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018948    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018955    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018961    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018967    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018972    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018979    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018990    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.018991 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.018995    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019003    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019009    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019021    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eda5bff9-904f-4553-9fc9-064638eaa41b" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="eda5bff9-904f-4553-9fc9-064638eaa41b" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019032    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019037    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019043    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019048    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019054    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019058    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019066    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df304276-0af3-4f39-b081-a079191e87bd" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019070    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="df304276-0af3-4f39-b081-a079191e87bd" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019076    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019080    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019139    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019146    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019153    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4f1c02b-f789-477a-8f79-26259c5f3ff5" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019160    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="eda5bff9-904f-4553-9fc9-064638eaa41b" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019166    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019172    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019177    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019182    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f2895a7c-0f93-4b65-b075-344281f03fe0" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019188    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="df304276-0af3-4f39-b081-a079191e87bd" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019193    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="902dd9ec-d12a-4d4e-a9e4-6ec6ebe13eb8" containerName="maas-api"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019258    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019263    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019313    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f89d9001-a18e-4b38-8ef9-accf63814ac6" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019319    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e5cc0d3-a71f-4099-91d8-87ee4f7bc9f3" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019325    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="995b377e-9998-4a98-a3d4-d11b9226dac5" containerName="istio-proxy"
Jul 29 05:07:51.019382 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.019331    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="82b4e5d7-0bf5-40b7-923c-2a3a70c205b0" containerName="istio-proxy"
Jul 29 05:07:51.022367 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.022345    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.027469 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.027445    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld4p\"/\"openshift-service-ca.crt\""
Jul 29 05:07:51.028261 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.028240    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bld4p\"/\"default-dockercfg-hmmx4\""
Jul 29 05:07:51.028584 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.028565    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bld4p\"/\"kube-root-ca.crt\""
Jul 29 05:07:51.036126 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.036102    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/must-gather-rs6pp"]
Jul 29 05:07:51.037146 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.037120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:51.192390 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.192357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log" limit=1024
Jul 29 05:07:51.206809 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.206773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkfpz\" (UniqueName: \"kubernetes.io/projected/587afe73-ec97-4f57-9280-c813818f30c4-kube-api-access-gkfpz\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.206955 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.206837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/587afe73-ec97-4f57-9280-c813818f30c4-must-gather-output\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.307499 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.307413    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/587afe73-ec97-4f57-9280-c813818f30c4-must-gather-output\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.307654 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.307532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkfpz\" (UniqueName: \"kubernetes.io/projected/587afe73-ec97-4f57-9280-c813818f30c4-kube-api-access-gkfpz\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.307861 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.307841    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/587afe73-ec97-4f57-9280-c813818f30c4-must-gather-output\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.320072 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.320045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkfpz\" (UniqueName: \"kubernetes.io/projected/587afe73-ec97-4f57-9280-c813818f30c4-kube-api-access-gkfpz\") pod \"must-gather-rs6pp\" (UID: \"587afe73-ec97-4f57-9280-c813818f30c4\") " pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.332083 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.332061    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/must-gather-rs6pp"
Jul 29 05:07:51.473336 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.473311    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/must-gather-rs6pp"]
Jul 29 05:07:51.476190 ip-10-0-129-12 kubenswrapper[2578]: W0729 05:07:51.476161    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod587afe73_ec97_4f57_9280_c813818f30c4.slice/crio-df837c4e78f752b5d0e1c01968e86f79b8530ecb8b0c336af239bfc6bca30ebf WatchSource:0}: Error finding container df837c4e78f752b5d0e1c01968e86f79b8530ecb8b0c336af239bfc6bca30ebf: Status 404 returned error can't find the container with id df837c4e78f752b5d0e1c01968e86f79b8530ecb8b0c336af239bfc6bca30ebf
Jul 29 05:07:51.478280 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.478263    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 29 05:07:51.848604 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:51.848568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/must-gather-rs6pp" event={"ID":"587afe73-ec97-4f57-9280-c813818f30c4","Type":"ContainerStarted","Data":"df837c4e78f752b5d0e1c01968e86f79b8530ecb8b0c336af239bfc6bca30ebf"}
Jul 29 05:07:52.857963 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:52.857862    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/must-gather-rs6pp" event={"ID":"587afe73-ec97-4f57-9280-c813818f30c4","Type":"ContainerStarted","Data":"53eb7f1f3cc5bee5edcb51169eee1d66d49596b2668c7b7069a033e9a0c72b65"}
Jul 29 05:07:52.857963 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:52.857924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/must-gather-rs6pp" event={"ID":"587afe73-ec97-4f57-9280-c813818f30c4","Type":"ContainerStarted","Data":"c87b3e9c9365dcfedf0e6b175348003d17a178f1a474161d6a89cf03a7d0d545"}
Jul 29 05:07:52.876110 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:52.876047    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld4p/must-gather-rs6pp" podStartSLOduration=1.82419661 podStartE2EDuration="2.876028048s" totalImagesPullingTime="1.051831438s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-29 05:07:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:07:52.873639783 +0000 UTC m=+3863.148656572" watchObservedRunningTime="2026-07-29 05:07:52.876028048 +0000 UTC m=+3863.151044838"
Jul 29 05:07:54.025346 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:54.025316    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-97qpv_99b6074b-caea-4900-9ce6-34596a3df637/global-pull-secret-syncer/0.log"
Jul 29 05:07:54.156915 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:54.156879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4465m_cb651ea7-f8e5-4090-a7d7-d369a789d9e8/konnectivity-agent/0.log"
Jul 29 05:07:54.260175 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:54.260137    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-12.ec2.internal_834222b015f197bd5eefa17c25b1b6b0/haproxy/0.log"
Jul 29 05:07:58.277010 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.276958    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/extract/0.log"
Jul 29 05:07:58.302927 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.302816    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/util/0.log"
Jul 29 05:07:58.326768 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.326721    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759ms669_721b1c05-44cc-4f36-9df3-5012995cb1ce/pull/0.log"
Jul 29 05:07:58.365573 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.365543    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/extract/0.log"
Jul 29 05:07:58.392483 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.392394    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/util/0.log"
Jul 29 05:07:58.415319 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.415291    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0ghr69_3c2bb03f-a4a2-485d-8049-084986ee7dd8/pull/0.log"
Jul 29 05:07:58.444866 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.444829    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/extract/0.log"
Jul 29 05:07:58.472634 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.472589    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/util/0.log"
Jul 29 05:07:58.495354 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.495322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed734xqs7_8886bc10-9e68-48ae-87e2-9a9bd15f2110/pull/0.log"
Jul 29 05:07:58.524167 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.524132    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/extract/0.log"
Jul 29 05:07:58.548452 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.548413    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/util/0.log"
Jul 29 05:07:58.573334 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:07:58.573280    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1kbc4f_c1309778-16a9-4f12-8ac6-5b1d0fa61239/pull/0.log"
Jul 29 05:08:01.239077 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:01.238973    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-xx4sg_896876a8-2a55-4822-bab3-2dfbad6e5d99/cluster-monitoring-operator/0.log"
Jul 29 05:08:01.479237 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:01.479205    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k85j_de6dfa54-8009-4de8-bf94-b7bbefd83b1d/node-exporter/0.log"
Jul 29 05:08:01.505428 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:01.505344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k85j_de6dfa54-8009-4de8-bf94-b7bbefd83b1d/kube-rbac-proxy/0.log"
Jul 29 05:08:01.533699 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:01.533659    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7k85j_de6dfa54-8009-4de8-bf94-b7bbefd83b1d/init-textfile/0.log"
Jul 29 05:08:02.159131 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:02.159103    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6877c5dbd6-qddrz_c3576584-23a0-426c-9c60-36a2606453cc/telemeter-client/0.log"
Jul 29 05:08:02.190227 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:02.190193    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6877c5dbd6-qddrz_c3576584-23a0-426c-9c60-36a2606453cc/reload/0.log"
Jul 29 05:08:02.213136 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:02.213065    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6877c5dbd6-qddrz_c3576584-23a0-426c-9c60-36a2606453cc/kube-rbac-proxy/0.log"
Jul 29 05:08:03.583935 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:03.583892    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-7ph28_0551bf59-fbf5-4bdf-80ed-1d05450f922e/networking-console-plugin/0.log"
Jul 29 05:08:04.085116 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.085077    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"]
Jul 29 05:08:04.092846 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.092816    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.099264 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.099231    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"]
Jul 29 05:08:04.137456 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.137417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-sys\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.137724 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.137704    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gcgnc\" (UniqueName: \"kubernetes.io/projected/dea5a620-3e42-436e-a2d7-76a42cd78d56-kube-api-access-gcgnc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.137894 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.137881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-lib-modules\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.138033 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.138020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-proc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.138136 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.138124    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-podres\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239160 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239123    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-sys\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gcgnc\" (UniqueName: \"kubernetes.io/projected/dea5a620-3e42-436e-a2d7-76a42cd78d56-kube-api-access-gcgnc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239194    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-lib-modules\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-proc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239247    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-podres\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239363 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239269    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-sys\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239560 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239393    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-podres\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239560 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239394    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-lib-modules\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.239560 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.239438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/dea5a620-3e42-436e-a2d7-76a42cd78d56-proc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.249033 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.248973    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gcgnc\" (UniqueName: \"kubernetes.io/projected/dea5a620-3e42-436e-a2d7-76a42cd78d56-kube-api-access-gcgnc\") pod \"perf-node-gather-daemonset-dhl8l\" (UID: \"dea5a620-3e42-436e-a2d7-76a42cd78d56\") " pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.258096 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.258072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/1.log"
Jul 29 05:08:04.264463 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.264418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-frgcp_b4627155-cd92-4def-a6e8-1477a4bec7fe/console-operator/2.log"
Jul 29 05:08:04.413629 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.413523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:04.608455 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.608417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"]
Jul 29 05:08:04.835483 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.835408    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6599cfc7c8-gdctw_40bab232-d8bf-47e0-9d03-6ec10222cdeb/console/0.log"
Jul 29 05:08:04.877453 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.877418    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-n26zc_7d7bf942-326b-4c52-ad16-d2b8e5912589/download-server/0.log"
Jul 29 05:08:04.957484 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.957384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l" event={"ID":"dea5a620-3e42-436e-a2d7-76a42cd78d56","Type":"ContainerStarted","Data":"cf9daec6d6cf6c19ceb0d5106541d2ca213121ba8f17503c11abd08417e65114"}
Jul 29 05:08:04.957484 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.957450    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l" event={"ID":"dea5a620-3e42-436e-a2d7-76a42cd78d56","Type":"ContainerStarted","Data":"a26b843012998057e382ec757427a126b0be75fd3313a133e3a14c0ad48b2027"}
Jul 29 05:08:04.958372 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:04.958344    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:05.492470 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:05.492394    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-4kz7m_196438db-4df3-4185-ab5a-9ec7289ca1e3/volume-data-source-validator/0.log"
Jul 29 05:08:06.603890 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:06.603860    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ks8v9_6d36f6db-3a79-4416-91f4-f1144977d617/dns/0.log"
Jul 29 05:08:06.628251 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:06.628217    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ks8v9_6d36f6db-3a79-4416-91f4-f1144977d617/kube-rbac-proxy/0.log"
Jul 29 05:08:06.731812 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:06.731778    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hsqxh_e8adbb30-a0d1-4caa-a2d6-1dde5d6de217/dns-node-resolver/0.log"
Jul 29 05:08:07.334613 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:07.334585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-tvxfx_fed1915d-3c73-4d25-b427-e119aecaa5b0/node-ca/0.log"
Jul 29 05:08:08.496831 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:08.496800    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-77l94_43ab3d0a-232f-45bb-93bb-cf20d244bf25/discovery/0.log"
Jul 29 05:08:08.640678 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:08.640649    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bdfv5_8ca0fb86-f420-491c-b4d3-d8d7f706f896/payload-pre-processing/0.log"
Jul 29 05:08:08.693065 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:08.693037    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fb4f4744f-ltrx6_36a75980-e622-410c-973f-a21cb2a908c4/router/0.log"
Jul 29 05:08:09.502893 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:09.502856    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-64qnw_4aabdd1e-2246-4a06-9a94-227a7a9d8e2f/serve-healthcheck-canary/0.log"
Jul 29 05:08:10.002401 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:10.002368    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-sg5z7_2702597e-99c7-4f44-8cb2-c9ee052dc112/insights-operator/0.log"
Jul 29 05:08:10.003521 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:10.003499    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-sg5z7_2702597e-99c7-4f44-8cb2-c9ee052dc112/insights-operator/1.log"
Jul 29 05:08:10.161175 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:10.161144    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6w5s_1547b10b-9358-41ab-bd3d-67131ea01beb/kube-rbac-proxy/0.log"
Jul 29 05:08:10.181434 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:10.181409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6w5s_1547b10b-9358-41ab-bd3d-67131ea01beb/exporter/0.log"
Jul 29 05:08:10.209621 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:10.209585    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l6w5s_1547b10b-9358-41ab-bd3d-67131ea01beb/extractor/0.log"
Jul 29 05:08:11.982255 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:11.982227    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l"
Jul 29 05:08:12.001246 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:12.001187    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bld4p/perf-node-gather-daemonset-dhl8l" podStartSLOduration=8.001162109 podStartE2EDuration="8.001162109s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-29 05:08:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-29 05:08:04.97801714 +0000 UTC m=+3875.253033907" watchObservedRunningTime="2026-07-29 05:08:12.001162109 +0000 UTC m=+3882.276178934"
Jul 29 05:08:13.029086 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:13.029060    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-fsgkm_937aba2e-d65b-4f31-bd6f-54df96944bd1/manager/0.log"
Jul 29 05:08:13.048608 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:13.048576    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-64c765c8-fsgkm_937aba2e-d65b-4f31-bd6f-54df96944bd1/copy-manifests/0.log"
Jul 29 05:08:14.519819 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:14.519742    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-77l94_43ab3d0a-232f-45bb-93bb-cf20d244bf25/discovery/0.log"
Jul 29 05:08:14.558275 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:14.558245    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-75c59548f9-gjjwj_9fde8888-2b9d-42ee-b60d-12a1f75a6d4b/manager/0.log"
Jul 29 05:08:14.616094 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:14.616057    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bdfv5_8ca0fb86-f420-491c-b4d3-d8d7f706f896/payload-pre-processing/0.log"
Jul 29 05:08:14.621111 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:14.621083    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-4ccxh_3a78c8b9-dcb5-4c57-b981-e17d8c496393/openshift-lws-operator/0.log"
Jul 29 05:08:14.658390 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:14.658360    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fb4f4744f-ltrx6_36a75980-e622-410c-973f-a21cb2a908c4/router/0.log"
Jul 29 05:08:16.285047 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:16.285004    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-77l94_43ab3d0a-232f-45bb-93bb-cf20d244bf25/discovery/0.log"
Jul 29 05:08:16.390356 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:16.390322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-bdfv5_8ca0fb86-f420-491c-b4d3-d8d7f706f896/payload-pre-processing/0.log"
Jul 29 05:08:16.424219 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:16.424180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5fb4f4744f-ltrx6_36a75980-e622-410c-973f-a21cb2a908c4/router/0.log"
Jul 29 05:08:19.832513 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:19.832481    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds_fc55f329-db6f-407b-a0ee-6a643ea4d03d/kube-storage-version-migrator-operator/1.log"
Jul 29 05:08:19.833145 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:19.833127    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-v2wds_fc55f329-db6f-407b-a0ee-6a643ea4d03d/kube-storage-version-migrator-operator/0.log"
Jul 29 05:08:20.881277 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.881250    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/kube-multus-additional-cni-plugins/0.log"
Jul 29 05:08:20.903286 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.903259    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/egress-router-binary-copy/0.log"
Jul 29 05:08:20.928451 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.928423    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/cni-plugins/0.log"
Jul 29 05:08:20.951599 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.951570    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/bond-cni-plugin/0.log"
Jul 29 05:08:20.973326 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.973289    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/routeoverride-cni/0.log"
Jul 29 05:08:20.996500 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:20.996478    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/whereabouts-cni-bincopy/0.log"
Jul 29 05:08:21.017712 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:21.017683    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-j5lf5_6b7af58c-724c-4b51-b2a6-df5a3ab4ba98/whereabouts-cni/0.log"
Jul 29 05:08:21.371064 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:21.371032    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-c7zj9_d8f66f9b-007e-4c36-b24c-29a9a1b67cff/kube-multus/0.log"
Jul 29 05:08:21.513659 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:21.513622    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qg8fx_c1759f39-c5c2-4798-a020-b3585fe0867e/network-metrics-daemon/0.log"
Jul 29 05:08:21.531112 ip-10-0-129-12 kubenswrapper[2578]: I0729 05:08:21.531088    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-qg8fx_c1759f39-c5c2-4798-a020-b3585fe0867e/kube-rbac-proxy/0.log"