Jul 07 18:44:28.351611 ip-10-0-141-88 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 18:44:28.722910 ip-10-0-141-88 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:28.722910 ip-10-0-141-88 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 18:44:28.722910 ip-10-0-141-88 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:28.722910 ip-10-0-141-88 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 18:44:28.722910 ip-10-0-141-88 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 18:44:28.724612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.724521    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 18:44:28.728136 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728112    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.728738 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728725    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.728738 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728739    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728744    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728749    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728754    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728759    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728765    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728778    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728783    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728788    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728793    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728798    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728802    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728807    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728820    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728825    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728831    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728835    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728840    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728844    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728853    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.728856 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728858    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728862    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728867    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728871    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728875    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728880    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728885    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728889    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728897    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728901    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728906    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728915    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728923    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728930    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728934    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728942    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728947    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728952    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728957    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.729683 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728962    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728967    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728975    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728981    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728991    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.728995    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729000    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729005    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729010    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729014    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729018    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729023    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729027    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729031    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729035    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729041    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729051    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729056    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729060    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.730467 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729065    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729069    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729074    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729081    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729086    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729090    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729095    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729100    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729105    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729114    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729118    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729123    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729127    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729132    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729137    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729141    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729146    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729151    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729155    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729160    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.730938 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729164    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729169    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729178    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729183    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729188    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729192    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729196    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729201    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729207    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729212    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729216    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729221    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729225    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729230    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729238    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729244    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729248    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729253    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.729257    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731439    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.731450 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731449    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731453    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731457    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731460    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731464    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731467    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731470    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731473    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731475    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731478    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731481    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731484    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731486    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731489    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731492    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731495    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731498    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731500    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731503    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731507    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.731944 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731511    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731514    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731516    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731519    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731523    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731527    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731529    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731532    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731534    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731537    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731540    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731542    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731545    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731548    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731552    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731555    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731558    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731560    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731563    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.732462 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731566    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731568    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731571    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731573    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731576    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731579    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731581    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731583    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731586    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731588    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731594    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731597    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731601    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731603    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731606    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731608    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731611    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731614    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731616    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.732939 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731619    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731621    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731624    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731626    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731629    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731631    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731633    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731636    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731640    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731643    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731646    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731648    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731651    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731654    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731656    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731659    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731661    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731664    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731666    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731669    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.733421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731674    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731678    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731682    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731686    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731691    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731695    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731699    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731703    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731706    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731709    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731711    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731714    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731717    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731719    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731722    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731724    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731727    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731729    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731732    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.731734    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.733894 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732131    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732136    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732139    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732142    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732145    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732148    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732151    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732153    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732156    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732158    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732161    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732163    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732167    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732171    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732174    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732177    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732180    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732183    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732186    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732188    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.734403 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732192    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732196    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732199    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732202    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732205    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732208    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732210    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732214    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732217    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732219    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732222    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732225    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732228    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732230    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732233    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732236    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732238    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732241    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732244    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732246    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.734921 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732249    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732252    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732254    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732257    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732259    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732262    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732264    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732267    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732270    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732273    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732275    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732278    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732280    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732283    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732285    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732288    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732290    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732293    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732295    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732298    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.735419 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732300    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732304    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732307    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732311    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732313    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732316    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732319    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732322    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732325    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732328    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732345    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732349    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732352    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732354    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732357    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732359    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732362    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732365    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732367    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.735901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732370    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732372    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732375    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732378    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732381    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732383    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732386    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732388    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732391    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732393    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732396    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732398    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732401    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732403    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732405    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732408    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732411    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732413    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732416    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.732418    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.736416 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732488    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732496    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732502    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732507    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732511    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732514    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732518    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732522    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732526    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732529    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732532    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732535    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732541    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732544    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732547    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732550    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732554    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732557    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732561    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732564    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732567    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732570    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732573    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732577    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 18:44:28.736910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732580    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732583    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732587    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732590    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732593    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732596    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732599    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732602    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732606    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732609    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732612    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732615    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732617    2578 flags.go:64] FLAG: --enable-server="true"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732620    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732625    2578 flags.go:64] FLAG: --event-burst="100"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732628    2578 flags.go:64] FLAG: --event-qps="50"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732631    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732634    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732637    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732640    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732644    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732647    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732650    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732653    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732656    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 18:44:28.737533 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732659    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732662    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732665    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732669    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732671    2578 flags.go:64] FLAG: --feature-gates=""
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732675    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732678    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732681    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732684    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732687    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732690    2578 flags.go:64] FLAG: --help="false"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732693    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732696    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732699    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732702    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732705    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732709    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732711    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732714    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732717    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732719    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732722    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732725    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732728    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 07 18:44:28.738136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732731    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732733    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732736    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732740    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732743    2578 flags.go:64] FLAG: --lock-file=""
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732746    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732748    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732751    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732757    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732760    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732763    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732765    2578 flags.go:64] FLAG: --logging-format="text"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732768    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732771    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732774    2578 flags.go:64] FLAG: --manifest-url=""
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732777    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732781    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732784    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732787    2578 flags.go:64] FLAG: --max-pods="110"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732792    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732795    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732798    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732800    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732803    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732806    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 18:44:28.738783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732809    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732816    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732819    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732822    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732825    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732828    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732834    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732837    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732840    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732843    2578 flags.go:64] FLAG: --port="10250"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732847    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732850    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0efccd1adfc57fb5d"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732853    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732856    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732859    2578 flags.go:64] FLAG: --register-node="true"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732862    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732865    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732872    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732875    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732878    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732882    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732885    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732888    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732891    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732893    2578 flags.go:64] FLAG: --runonce="false"
Jul 07 18:44:28.739431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732896    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732899    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732903    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732906    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732909    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732911    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732914    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732917    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732920    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732923    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732925    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732928    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732931    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732934    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732937    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732942    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732945    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732949    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732956    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732959    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732961    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732964    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732967    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732970    2578 flags.go:64] FLAG: --v="2"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732973    2578 flags.go:64] FLAG: --version="false"
Jul 07 18:44:28.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732985    2578 flags.go:64] FLAG: --vmodule=""
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732989    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.732992    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733114    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733117    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733120    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733122    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733125    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733127    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733133    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733136    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733139    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733141    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733144    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733146    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733149    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733152    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733155    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733157    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733160    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.740655 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733162    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733165    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733167    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733170    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733174    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733177    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733179    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733181    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733184    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733186    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733189    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733191    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733194    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733197    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733199    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733202    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733204    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733207    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733209    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733212    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.741181 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733216    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733220    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733223    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733225    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733228    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733231    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733234    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733236    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733239    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733241    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733244    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733246    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733249    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733251    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733254    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733257    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733261    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733263    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733266    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733268    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.741685 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733271    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733273    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733276    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733278    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733281    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733283    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733286    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733289    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733292    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733294    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733296    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733299    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733301    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733305    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733308    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733311    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733313    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733316    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733318    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733321    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.742174 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733324    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733326    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733343    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733346    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733348    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733351    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733354    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733357    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733360    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733364    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733368    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733371    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733374    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733377    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733379    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733382    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733384    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733387    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733389    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.742703 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733394    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733397    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.733400    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.733919    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.740452    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.740469    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.741172    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.741179    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741236    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741242    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741246    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741249    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741253    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741255    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741258    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.743166 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741262    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741265    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741267    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741270    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741272    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741275    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741278    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741281    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741283    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741286    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741288    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741291    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741293    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741296    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741299    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741301    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741304    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741306    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741309    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741311    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.743556 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741314    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741317    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741321    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741326    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741329    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741344    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741346    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741349    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741352    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741354    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741358    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741362    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741365    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741368    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741371    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741374    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741376    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741379    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.744029 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741382    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741385    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741388    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741391    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741394    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741396    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741399    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741402    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741404    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741408    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741411    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741414    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741417    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741420    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741422    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741427    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741431    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741434    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741437    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.744502 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741440    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741443    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741446    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741449    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741451    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741454    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741457    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741460    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741462    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741465    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741467    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741470    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741472    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741474    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741477    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741479    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741482    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741484    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741487    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741489    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.744949 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741492    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741494    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741497    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741499    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741502    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741504    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741507    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741509    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741512    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741515    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741519    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741521    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741524    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741526    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.741531    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:28.745466 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741643    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741648    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741651    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741654    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741657    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741660    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741663    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741666    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741669    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741671    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741674    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741676    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741679    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741681    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741684    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741686    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741689    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741692    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741694    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741697    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 18:44:28.745830 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741699    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741702    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741704    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741707    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741709    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741713    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741716    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741719    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741722    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741724    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741727    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741729    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741733    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741737    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741740    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741742    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741745    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741748    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741752    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 18:44:28.746315 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741755    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741757    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741760    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741762    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741764    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741767    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741769    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741772    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741774    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741777    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741779    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741781    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741784    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741786    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741789    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741791    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741794    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741796    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741799    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 18:44:28.746847 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741802    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741804    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741807    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741810    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741813    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741816    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741818    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741821    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741823    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741826    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741828    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741831    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741833    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741836    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741838    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741842    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741846    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741849    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741852    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741855    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 18:44:28.747314 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741858    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741860    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741863    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741865    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741868    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741870    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741872    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741875    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741877    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741880    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741882    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741885    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741888    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741890    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741893    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741895    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741899    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741901    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741903    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741906    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 18:44:28.747845 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:28.741908    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.741913    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.742020    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.743935    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.745083    2578 server.go:1019] "Starting client certificate rotation"
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.745179    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.745208    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 18:44:28.748375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.747215    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:44:28.749363 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.749350    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 18:44:28.760769 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.760743    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 07 18:44:28.762625 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.762610    2578 log.go:25] "Validated CRI v1 image API"
Jul 07 18:44:28.763363 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.763343    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 18:44:28.765410 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.765392    2578 fs.go:135] Filesystem UUIDs: map[57042f64-6025-4a6c-ad47-a8eea93e0860:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 9baeb3df-6828-40c4-b4ad-270668d0282f:/dev/nvme0n1p4]
Jul 07 18:44:28.765470 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.765410    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 18:44:28.771138 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.771006    2578 manager.go:216] Machine: {Timestamp:2026-07-07 18:44:28.768997238 +0000 UTC m=+0.308598590 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112326 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2dfe9c613c4dc7cff9bb220857990e SystemUUID:ec2dfe9c-613c-4dc7-cff9-bb220857990e BootID:d1218b89-789d-4f56-a361-d4f8a27c4020 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:92:84:47:2f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:92:84:47:2f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:31:c7:bc:a3:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 18:44:28.771138 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.771103    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 18:44:28.771289 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.771182    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 18:44:28.773960 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.773931    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 18:44:28.774100 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.773961    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-88.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 18:44:28.774619 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.774610    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 18:44:28.774653 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.774621    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 18:44:28.774653 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.774628    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:44:28.775169 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.775160    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 18:44:28.775668 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.775652    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:44:28.776311 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.776302    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 18:44:28.779129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779118    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:44:28.779245 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779236    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 18:44:28.779286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779264    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 18:44:28.779286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779273    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 18:44:28.779286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779284    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 18:44:28.779416 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779293    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 07 18:44:28.779416 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779301    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 18:44:28.779692 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779679    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:44:28.779733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.779702    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 18:44:28.781632 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.781606    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 18:44:28.783200 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.783185    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 18:44:28.783261 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.783216    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 18:44:28.784060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784049    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784064    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784071    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784076    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784085    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784092    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784103    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 18:44:28.784116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784111    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 18:44:28.784302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784122    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 18:44:28.784302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784129    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 18:44:28.784302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784138    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 18:44:28.784302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784143    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 18:44:28.784856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784844    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 18:44:28.784856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.784854    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 18:44:28.787980 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.787964    2578 server.go:1268] "Started kubelet"
Jul 07 18:44:28.788071 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.788042    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 18:44:28.788519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.788463    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 18:44:28.788584 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.788541    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 18:44:28.788693 ip-10-0-141-88 systemd[1]: Started Kubernetes Kubelet.
Jul 07 18:44:28.792993 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.792897    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 18:44:28.793865 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.793630    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-88.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 18:44:28.794043 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.794017    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-88.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 18:44:28.794138 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.794054    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 18:44:28.794703 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.794624    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 18:44:28.795276 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.795258    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 18:44:28.798448 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.797496    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-88.ec2.internal.18c01634dfd2715a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-88.ec2.internal,UID:ip-10-0-141-88.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-88.ec2.internal,},FirstTimestamp:2026-07-07 18:44:28.787937626 +0000 UTC m=+0.327538977,LastTimestamp:2026-07-07 18:44:28.787937626 +0000 UTC m=+0.327538977,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-88.ec2.internal,}"
Jul 07 18:44:28.798726 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.798710    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-srpxm"
Jul 07 18:44:28.801819 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.801112    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 18:44:28.801819 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.801211    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 18:44:28.801819 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.801268    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:28.802133 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802010    2578 factory.go:55] Registering systemd factory
Jul 07 18:44:28.802133 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802027    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 07 18:44:28.802290 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802277    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 18:44:28.802409 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802392    2578 factory.go:153] Registering CRI-O factory
Jul 07 18:44:28.802478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802426    2578 factory.go:223] Registration of the crio container factory successfully
Jul 07 18:44:28.802478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802444    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 18:44:28.802478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802455    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 18:44:28.802478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802476    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 18:44:28.802663 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802501    2578 factory.go:103] Registering Raw factory
Jul 07 18:44:28.802663 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802516    2578 manager.go:1196] Started watching for new ooms in manager
Jul 07 18:44:28.802663 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802656    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 18:44:28.802762 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802665    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 18:44:28.802935 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.802915    2578 manager.go:349] Starting recovery of all containers
Jul 07 18:44:28.807218 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.807181    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-srpxm"
Jul 07 18:44:28.813422 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.813259    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:28.814837 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.814819    2578 manager.go:354] Recovery completed
Jul 07 18:44:28.816195 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.816180    2578 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-88.ec2.internal\" not found" node="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:28.820789 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.820775    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:28.822858 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.822840    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:28.822939 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.822873    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:28.822939 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.822886    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:28.823494 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.823477    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 18:44:28.823494 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.823484    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:28.823494 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.823491    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 18:44:28.823676 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.823508    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 18:44:28.824205 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824187    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:28.824299 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824217    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:28.824299 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824227    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:28.824547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824535    2578 policy_none.go:49] "None policy: Start"
Jul 07 18:44:28.824595 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824551    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 18:44:28.824595 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.824561    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 18:44:28.825687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.825675    2578 policy_none.go:47] "Start"
Jul 07 18:44:28.863965 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.863843    2578 manager.go:337] "Starting Device Plugin manager"
Jul 07 18:44:28.864086 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.863986    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 18:44:28.864086 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.863999    2578 server.go:87] "Starting device plugin registration server"
Jul 07 18:44:28.864248 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.864236    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 18:44:28.864310 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.864251    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 18:44:28.864440 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.864426    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 18:44:28.864526 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.864501    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 18:44:28.864526 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.864512    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 18:44:28.865025 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.865007    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 18:44:28.865090 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.865059    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:28.939628 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.939584    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 18:44:28.940802 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.940786    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 18:44:28.940854 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.940823    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 18:44:28.940854 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.940846    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 18:44:28.940945 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.940879    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 18:44:28.943252 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.943230    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:28.965139 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.965123    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:28.965890 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.965866    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:28.965985 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.965901    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:28.965985 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.965914    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:28.965985 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.965936    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:28.984635 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:28.984611    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:28.984745 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:28.984637    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-88.ec2.internal\": node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.001749 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.001722    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.041451 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.041427    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"]
Jul 07 18:44:29.041527 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.041493    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:29.042324 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.042307    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:29.042424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.042354    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:29.042424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.042368    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:29.043550 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.043539    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:29.043671 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.043657    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.043718 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.043683    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:29.044217 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044202    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:29.044217 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044217    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:29.044217 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044227    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:29.044424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044239    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:29.044424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044241    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:29.044424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.044248    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:29.045203 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.045190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.045246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.045215    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 18:44:29.046240 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.046224    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 18:44:29.046325 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.046248    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 18:44:29.046325 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.046257    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeHasSufficientPID"
Jul 07 18:44:29.073891 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.073874    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-88.ec2.internal\" not found" node="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.077149 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.077135    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-88.ec2.internal\" not found" node="ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.101824 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.101806    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.104665 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.104650    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.104730 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.104672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.104730 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.104692    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad95ec8a8c8db5b9207b4526a1564dff-config\") pod \"kube-apiserver-proxy-ip-10-0-141-88.ec2.internal\" (UID: \"ad95ec8a8c8db5b9207b4526a1564dff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.202439 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.202404    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.205581 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.205667 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.205667 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205625    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad95ec8a8c8db5b9207b4526a1564dff-config\") pod \"kube-apiserver-proxy-ip-10-0-141-88.ec2.internal\" (UID: \"ad95ec8a8c8db5b9207b4526a1564dff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.205741 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205670    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.205741 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/856cf93bbd03080e7dae3757ea4a90e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal\" (UID: \"856cf93bbd03080e7dae3757ea4a90e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.205741 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.205672    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad95ec8a8c8db5b9207b4526a1564dff-config\") pod \"kube-apiserver-proxy-ip-10-0-141-88.ec2.internal\" (UID: \"ad95ec8a8c8db5b9207b4526a1564dff\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.303134 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.303073    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.377413 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.377380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.379890 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:29.379875    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:29.403775 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.403753    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:29.504316 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:29.504266    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:30.728180 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:30.728156    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:30.828737 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:30.828707    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:30.868017 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:30.867993    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 18:44:30.868444 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:30.868131    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:44:30.868444 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:30.868141    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 18:44:30.928937 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:30.928907    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:30.932608 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:30.932563    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 18:39:29 +0000 UTC" deadline="2027-12-31 08:37:36.646089274 +0000 UTC"
Jul 07 18:44:30.932720 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:30.932608    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12997h53m5.713486581s"
Jul 07 18:44:31.001219 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:31.001190    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad95ec8a8c8db5b9207b4526a1564dff.slice/crio-1b1da60251c5deca0630228b1214a62118633d388e3070d0025acd1fbd38c6c0 WatchSource:0}: Error finding container 1b1da60251c5deca0630228b1214a62118633d388e3070d0025acd1fbd38c6c0: Status 404 returned error can't find the container with id 1b1da60251c5deca0630228b1214a62118633d388e3070d0025acd1fbd38c6c0
Jul 07 18:44:31.001470 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:31.001443    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod856cf93bbd03080e7dae3757ea4a90e5.slice/crio-8c4ebdc2a7a77f63fd9115727716cc72ed7a7b3f4edeed058ba2c8db24081169 WatchSource:0}: Error finding container 8c4ebdc2a7a77f63fd9115727716cc72ed7a7b3f4edeed058ba2c8db24081169: Status 404 returned error can't find the container with id 8c4ebdc2a7a77f63fd9115727716cc72ed7a7b3f4edeed058ba2c8db24081169
Jul 07 18:44:31.005528 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.005515    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:44:31.029201 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.029183    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:31.067656 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.067600    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal" event={"ID":"ad95ec8a8c8db5b9207b4526a1564dff","Type":"ContainerStarted","Data":"1b1da60251c5deca0630228b1214a62118633d388e3070d0025acd1fbd38c6c0"}
Jul 07 18:44:31.068624 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.068604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal" event={"ID":"856cf93bbd03080e7dae3757ea4a90e5","Type":"ContainerStarted","Data":"8c4ebdc2a7a77f63fd9115727716cc72ed7a7b3f4edeed058ba2c8db24081169"}
Jul 07 18:44:31.130106 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.128936    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:31.130106 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.129269    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-88.ec2.internal\" not found"
Jul 07 18:44:31.178325 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.178307    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:31.225194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.225167    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:31.237671 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.237652    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:44:31.238660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.238628    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal"
Jul 07 18:44:31.249147 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.249104    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 18:44:31.903947 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.903918    2578 apiserver.go:52] "Watching apiserver"
Jul 07 18:44:31.914104 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.914079    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 18:44:31.915679 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.915656    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-ckp45","kube-system/konnectivity-agent-6gzt2","kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl","openshift-dns/node-resolver-rzzmb","openshift-image-registry/node-ca-h2tpp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal","openshift-multus/multus-additional-cni-plugins-d89ld","openshift-cluster-node-tuning-operator/tuned-9cqcg","openshift-multus/multus-wprfc","openshift-multus/network-metrics-daemon-rc6rs","openshift-network-diagnostics/network-check-target-xv6n4","openshift-network-operator/iptables-alerter-8pxr8","openshift-ovn-kubernetes/ovnkube-node-hvjjv"]
Jul 07 18:44:31.916894 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.916877    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.917850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.917826    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:31.918938 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.918921    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.920055 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.920039    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.921053 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.921036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:31.922102 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.922083    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:31.923518 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.923501    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.924733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.924714    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.925536 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.925517    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 18:44:31.925957 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.925938    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:31.927370 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.927353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:31.927454 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.927432    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:31.928551 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.928530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:31.928659 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.928608    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:31.929884 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.929862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:31.929970 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.929941    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:31.931803 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.931788    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 18:44:31.932545 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.932524    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.933539 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.933518    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 18:44:31.933638 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.933619    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.934018 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.933998    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.934110 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.934035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.934181 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.934157    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rbjh8\""
Jul 07 18:44:31.935551 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.935529    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 18:44:31.935664 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.935600    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.936039 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.936016    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 18:44:31.938141 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4kg8\" (UniqueName: \"kubernetes.io/projected/93495985-21a5-4fd5-aaa8-2a22912a2f20-kube-api-access-h4kg8\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:31.938246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.938246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cnibin\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.938246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-systemd-units\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.938386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-kubelet\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.938386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlxvk\" (UniqueName: \"kubernetes.io/projected/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kube-api-access-tlxvk\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.938386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.938386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rnmgm\" (UniqueName: \"kubernetes.io/projected/a5fa7945-735b-41c9-8cb3-8ffe4680d298-kube-api-access-rnmgm\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.938386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-multus-certs\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.938599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938396    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-kubelet\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.938599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c638e6-f285-4ecc-89db-615cf11511da-ovn-node-metrics-cert\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.938599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.938599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-etc-kubernetes\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.938599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938547    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-etc-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.938876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938588    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-lib-modules\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.938876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-var-lib-kubelet\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.938876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-device-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.938876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-conf-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.939032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvkmw\" (UniqueName: \"kubernetes.io/projected/6c118053-9794-435c-b760-07e63fdd2f9a-kube-api-access-wvkmw\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.939032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-run\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.939032 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.938914    2578 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad1a6a367df3e3557cbe233f64e018cdc266006184a3fdd07e6bd3be8b2c775a: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1"
Jul 07 18:44:31.939032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.938999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-host\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.939032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939028    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-sys-fs\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939049    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939082    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93495985-21a5-4fd5-aaa8-2a22912a2f20-host-slash\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.939087    2578 kuberuntime_manager.go:1459] "Unhandled Error" err="container haproxy start failed in pod kube-apiserver-proxy-ip-10-0-141-88.ec2.internal_kube-system(ad95ec8a8c8db5b9207b4526a1564dff): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad1a6a367df3e3557cbe233f64e018cdc266006184a3fdd07e6bd3be8b2c775a: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:31.939129    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad1a6a367df3e3557cbe233f64e018cdc266006184a3fdd07e6bd3be8b2c775a: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal" podUID="ad95ec8a8c8db5b9207b4526a1564dff"
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-bin\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939172    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.939225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s85r4\" (UniqueName: \"kubernetes.io/projected/7c9539cc-a539-4ef1-b742-f971f715382e-kube-api-access-s85r4\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939238    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-socket-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939282    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-registration-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-system-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-cni-binary-copy\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939421    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-multus\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939443    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939466    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r4gp8\""
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939519    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.939601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93495985-21a5-4fd5-aaa8-2a22912a2f20-iptables-alerter-script\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939608    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-netns\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-config\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939755    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939760    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939759    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-system-cni-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939790    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939798    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-socket-dir-parent\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-k8s-cni-cncf-io\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939930    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939943    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.939978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-log-socket\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l452g\" (UniqueName: \"kubernetes.io/projected/623ea161-df1c-46b0-814a-33c155e98c21-kube-api-access-l452g\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940069    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d007671-051a-4cae-8609-94302754e98a-konnectivity-ca\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940077    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 18:44:31.940116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940111    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-bin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940131    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940139    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-env-overrides\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940177    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940074    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940240    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-ss5f6\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940303    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-q9vlw\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940178    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45nh8\" (UniqueName: \"kubernetes.io/projected/0678dc6a-a5ef-4488-8d21-671bb7048a74-kube-api-access-45nh8\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940387    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/623ea161-df1c-46b0-814a-33c155e98c21-serviceca\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940182    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-modprobe-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940447    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysconfig\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940472    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qswps\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940135    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-dvfp5\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-hostroot\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-netd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-conf\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940479    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940589    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-etc-tuned\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-os-release\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.940872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940709    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-os-release\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941333    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941490    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-tg8zv\""
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.940733    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-node-log\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941607    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-slash\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941658    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-var-lib-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glqj4\" (UniqueName: \"kubernetes.io/projected/a6c638e6-f285-4ecc-89db-615cf11511da-kube-api-access-glqj4\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941740    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-7gxkb\""
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0678dc6a-a5ef-4488-8d21-671bb7048a74-tmp-dir\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941771    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/623ea161-df1c-46b0-814a-33c155e98c21-host\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941786    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-grmxz\""
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-kubernetes\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.941812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941818    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-netns\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941841    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941862    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-systemd\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-sys\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-tmp\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941926    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-script-lib\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0678dc6a-a5ef-4488-8d21-671bb7048a74-hosts-file\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.941996    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d007671-051a-4cae-8609-94302754e98a-agent-certs\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-cnibin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-multus-daemon-config\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-systemd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-ovn\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-binary-copy\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.942492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.942172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:31.948304 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.948287    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 18:44:31.966339 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.966321    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tdjw"
Jul 07 18:44:31.976103 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:31.976044    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5tdjw"
Jul 07 18:44:32.008560 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.008533    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:32.026428 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.026404    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 18:44:32.042344 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-os-release\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.042456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-os-release\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.042456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-node-log\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-slash\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042405    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-os-release\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.042456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-var-lib-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042469    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042488    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-slash\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-node-log\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042473    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-os-release\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042497    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glqj4\" (UniqueName: \"kubernetes.io/projected/a6c638e6-f285-4ecc-89db-615cf11511da-kube-api-access-glqj4\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042540    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-var-lib-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0678dc6a-a5ef-4488-8d21-671bb7048a74-tmp-dir\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042573    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/623ea161-df1c-46b0-814a-33c155e98c21-host\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042596    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-kubernetes\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042618    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-netns\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042661    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/623ea161-df1c-46b0-814a-33c155e98c21-host\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042687    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-systemd\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042698    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-kubernetes\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-sys\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042734    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-systemd\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.042752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042761    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-netns\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042776    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-sys\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042777    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-ovn-kubernetes\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-tmp\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042825    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-script-lib\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0678dc6a-a5ef-4488-8d21-671bb7048a74-hosts-file\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d007671-051a-4cae-8609-94302754e98a-agent-certs\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-cnibin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042919    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0678dc6a-a5ef-4488-8d21-671bb7048a74-tmp-dir\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042931    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0678dc6a-a5ef-4488-8d21-671bb7048a74-hosts-file\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-multus-daemon-config\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042973    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-cnibin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.042989    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-systemd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-ovn\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-binary-copy\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-dbus\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.043566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4kg8\" (UniqueName: \"kubernetes.io/projected/93495985-21a5-4fd5-aaa8-2a22912a2f20-kube-api-access-h4kg8\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-ovn\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043223    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cnibin\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043188    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-systemd-units\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043255    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-etc-selinux\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-kubelet\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlxvk\" (UniqueName: \"kubernetes.io/projected/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kube-api-access-tlxvk\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043350    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043380    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-tuning-conf-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rnmgm\" (UniqueName: \"kubernetes.io/projected/a5fa7945-735b-41c9-8cb3-8ffe4680d298-kube-api-access-rnmgm\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043439    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s9k\" (UniqueName: \"kubernetes.io/projected/0edc73fa-0c68-40aa-81c3-08153894f4e5-kube-api-access-p6s9k\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043483    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-multus-daemon-config\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043486    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-script-lib\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.044426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-kubelet-config\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-kubelet\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043544    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-systemd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-multus-certs\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043580    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-systemd-units\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043585    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cnibin\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043591    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-multus-certs\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043611    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-kubelet\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043673    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-kubelet\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c638e6-f285-4ecc-89db-615cf11511da-ovn-node-metrics-cert\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043755    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-binary-copy\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-etc-kubernetes\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-etc-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043819    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-etc-kubernetes\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-lib-modules\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043868    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-var-lib-kubelet\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-device-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-conf-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043993    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-lib-modules\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044012    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-etc-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044018    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.043998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvkmw\" (UniqueName: \"kubernetes.io/projected/6c118053-9794-435c-b760-07e63fdd2f9a-kube-api-access-wvkmw\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-run\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-var-lib-kubelet\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-host\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044096    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-conf-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-sys-fs\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-device-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93495985-21a5-4fd5-aaa8-2a22912a2f20-host-slash\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044141    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-run\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-bin\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.045933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044170    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-host\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044183    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s85r4\" (UniqueName: \"kubernetes.io/projected/7c9539cc-a539-4ef1-b742-f971f715382e-kube-api-access-s85r4\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044188    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-sys-fs\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044207    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/93495985-21a5-4fd5-aaa8-2a22912a2f20-host-slash\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044218    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044250    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a5fa7945-735b-41c9-8cb3-8ffe4680d298-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044266    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-socket-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044231    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-bin\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kubelet-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044307    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-registration-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044333    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-system-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044358    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-cni-binary-copy\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044369    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-socket-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-multus\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044405    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93495985-21a5-4fd5-aaa8-2a22912a2f20-iptables-alerter-script\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044425    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4fcec571-83b3-4cf2-9648-2920fda6f1ab-registration-dir\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044429    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-system-cni-dir\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.046824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044431    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-netns\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044472    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-run-netns\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-config\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044502    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-multus\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044509    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-system-cni-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044534    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-socket-dir-parent\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-k8s-cni-cncf-io\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044598    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-log-socket\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l452g\" (UniqueName: \"kubernetes.io/projected/623ea161-df1c-46b0-814a-33c155e98c21-kube-api-access-l452g\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044660    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d007671-051a-4cae-8609-94302754e98a-konnectivity-ca\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-bin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-env-overrides\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45nh8\" (UniqueName: \"kubernetes.io/projected/0678dc6a-a5ef-4488-8d21-671bb7048a74-kube-api-access-45nh8\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/623ea161-df1c-46b0-814a-33c155e98c21-serviceca\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-modprobe-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysconfig\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.047634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-hostroot\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044858    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-netd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-conf\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-etc-tuned\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.044948    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6c118053-9794-435c-b760-07e63fdd2f9a-cni-binary-copy\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045033    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-ovnkube-config\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045084    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/93495985-21a5-4fd5-aaa8-2a22912a2f20-iptables-alerter-script\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045156    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysconfig\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045386    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-run-openvswitch\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045386    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-hostroot\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a5fa7945-735b-41c9-8cb3-8ffe4680d298-system-cni-dir\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045452    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a6c638e6-f285-4ecc-89db-615cf11511da-env-overrides\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045463    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-host-cni-netd\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045470    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045499    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-multus-socket-dir-parent\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-run-k8s-cni-cncf-io\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a6c638e6-f285-4ecc-89db-615cf11511da-log-socket\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048219 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045616    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-modprobe-d\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045662    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7c9539cc-a539-4ef1-b742-f971f715382e-etc-sysctl-conf\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6c118053-9794-435c-b760-07e63fdd2f9a-host-var-lib-cni-bin\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.045676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/623ea161-df1c-46b0-814a-33c155e98c21-serviceca\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.046012    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5d007671-051a-4cae-8609-94302754e98a-konnectivity-ca\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.046973    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-tmp\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.047134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5d007671-051a-4cae-8609-94302754e98a-agent-certs\") pod \"konnectivity-agent-6gzt2\" (UID: \"5d007671-051a-4cae-8609-94302754e98a\") " pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.047289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a6c638e6-f285-4ecc-89db-615cf11511da-ovn-node-metrics-cert\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.048716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.047980    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7c9539cc-a539-4ef1-b742-f971f715382e-etc-tuned\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.057164 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s85r4\" (UniqueName: \"kubernetes.io/projected/7c9539cc-a539-4ef1-b742-f971f715382e-kube-api-access-s85r4\") pod \"tuned-9cqcg\" (UID: \"7c9539cc-a539-4ef1-b742-f971f715382e\") " pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.057164 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057150    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-glqj4\" (UniqueName: \"kubernetes.io/projected/a6c638e6-f285-4ecc-89db-615cf11511da-kube-api-access-glqj4\") pod \"ovnkube-node-hvjjv\" (UID: \"a6c638e6-f285-4ecc-89db-615cf11511da\") " pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.057317 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057162    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlxvk\" (UniqueName: \"kubernetes.io/projected/4fcec571-83b3-4cf2-9648-2920fda6f1ab-kube-api-access-tlxvk\") pod \"aws-ebs-csi-driver-node-x8thl\" (UID: \"4fcec571-83b3-4cf2-9648-2920fda6f1ab\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.057317 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057150    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rnmgm\" (UniqueName: \"kubernetes.io/projected/a5fa7945-735b-41c9-8cb3-8ffe4680d298-kube-api-access-rnmgm\") pod \"multus-additional-cni-plugins-d89ld\" (UID: \"a5fa7945-735b-41c9-8cb3-8ffe4680d298\") " pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.057424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057375    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvkmw\" (UniqueName: \"kubernetes.io/projected/6c118053-9794-435c-b760-07e63fdd2f9a-kube-api-access-wvkmw\") pod \"multus-wprfc\" (UID: \"6c118053-9794-435c-b760-07e63fdd2f9a\") " pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.057474 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057422    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4kg8\" (UniqueName: \"kubernetes.io/projected/93495985-21a5-4fd5-aaa8-2a22912a2f20-kube-api-access-h4kg8\") pod \"iptables-alerter-8pxr8\" (UID: \"93495985-21a5-4fd5-aaa8-2a22912a2f20\") " pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.057559 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.057543    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l452g\" (UniqueName: \"kubernetes.io/projected/623ea161-df1c-46b0-814a-33c155e98c21-kube-api-access-l452g\") pod \"node-ca-h2tpp\" (UID: \"623ea161-df1c-46b0-814a-33c155e98c21\") " pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.060364 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.058242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-45nh8\" (UniqueName: \"kubernetes.io/projected/0678dc6a-a5ef-4488-8d21-671bb7048a74-kube-api-access-45nh8\") pod \"node-resolver-rzzmb\" (UID: \"0678dc6a-a5ef-4488-8d21-671bb7048a74\") " pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.070873 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.070850    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:32d6df0cb6282bc5ba571a8de322fe598afdf22e817f5a7dc92db3274dbdb9a1\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: reading blob sha256:ad1a6a367df3e3557cbe233f64e018cdc266006184a3fdd07e6bd3be8b2c775a: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal" podUID="ad95ec8a8c8db5b9207b4526a1564dff"
Jul 07 18:44:32.145251 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:32.145251 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145243    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-dbus\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145335    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-dbus\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.145362    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s9k\" (UniqueName: \"kubernetes.io/projected/0edc73fa-0c68-40aa-81c3-08153894f4e5-kube-api-access-p6s9k\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.145414    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:44:32.645398772 +0000 UTC m=+3.061690723 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:32.145478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-kubelet-config\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.145894 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.145489    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:32.145894 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.145509    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-kubelet-config\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.145894 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.145539    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:32.645524159 +0000 UTC m=+3.061816109 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:32.156327 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.156302    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:32.156327 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.156321    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:32.156327 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.156331    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:32.156498 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.156377    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:32.656364953 +0000 UTC m=+3.072656917 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:32.164161 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.164135    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s9k\" (UniqueName: \"kubernetes.io/projected/0edc73fa-0c68-40aa-81c3-08153894f4e5-kube-api-access-p6s9k\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.226506 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.226430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-wprfc"
Jul 07 18:44:32.233535 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.233513    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8pxr8"
Jul 07 18:44:32.243432 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.243413    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:32.249442 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.249421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl"
Jul 07 18:44:32.257129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.257110    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rzzmb"
Jul 07 18:44:32.262706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.262689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-h2tpp"
Jul 07 18:44:32.270418 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.270394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-9cqcg"
Jul 07 18:44:32.276142 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.276123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-d89ld"
Jul 07 18:44:32.282538 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.282518    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:32.451969 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.451940    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod623ea161_df1c_46b0_814a_33c155e98c21.slice/crio-9b957c203fa0a33d2c6af556dce98108437fa86e6d82ae51c6b96f68f1b9a242 WatchSource:0}: Error finding container 9b957c203fa0a33d2c6af556dce98108437fa86e6d82ae51c6b96f68f1b9a242: Status 404 returned error can't find the container with id 9b957c203fa0a33d2c6af556dce98108437fa86e6d82ae51c6b96f68f1b9a242
Jul 07 18:44:32.463636 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.463608    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 18:44:32.466365 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.466339    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6c638e6_f285_4ecc_89db_615cf11511da.slice/crio-57e300967f0291cbb55a62155873b3a4d07f0ddb150d03a0aa8b20e75ae7323b WatchSource:0}: Error finding container 57e300967f0291cbb55a62155873b3a4d07f0ddb150d03a0aa8b20e75ae7323b: Status 404 returned error can't find the container with id 57e300967f0291cbb55a62155873b3a4d07f0ddb150d03a0aa8b20e75ae7323b
Jul 07 18:44:32.467112 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.467077    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fcec571_83b3_4cf2_9648_2920fda6f1ab.slice/crio-ec950f9205b906953aab6a62a87c00e051b8f0d0e50b7589559581856d0209c4 WatchSource:0}: Error finding container ec950f9205b906953aab6a62a87c00e051b8f0d0e50b7589559581856d0209c4: Status 404 returned error can't find the container with id ec950f9205b906953aab6a62a87c00e051b8f0d0e50b7589559581856d0209c4
Jul 07 18:44:32.471023 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.470732    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d007671_051a_4cae_8609_94302754e98a.slice/crio-81fbb9bf25ea7734d6a92e98b81df5e5fc842d8cbcff87e745fcfa5fc232d41e WatchSource:0}: Error finding container 81fbb9bf25ea7734d6a92e98b81df5e5fc842d8cbcff87e745fcfa5fc232d41e: Status 404 returned error can't find the container with id 81fbb9bf25ea7734d6a92e98b81df5e5fc842d8cbcff87e745fcfa5fc232d41e
Jul 07 18:44:32.474367 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.474284    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93495985_21a5_4fd5_aaa8_2a22912a2f20.slice/crio-e781eece33a32a60c7d4491d8c04b05110967637cd709c51a962c00f70c01608 WatchSource:0}: Error finding container e781eece33a32a60c7d4491d8c04b05110967637cd709c51a962c00f70c01608: Status 404 returned error can't find the container with id e781eece33a32a60c7d4491d8c04b05110967637cd709c51a962c00f70c01608
Jul 07 18:44:32.474916 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.474894    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0678dc6a_a5ef_4488_8d21_671bb7048a74.slice/crio-34fa7954029a3a03477760c32d034a00c9dc21f648007a06510762c36307ada9 WatchSource:0}: Error finding container 34fa7954029a3a03477760c32d034a00c9dc21f648007a06510762c36307ada9: Status 404 returned error can't find the container with id 34fa7954029a3a03477760c32d034a00c9dc21f648007a06510762c36307ada9
Jul 07 18:44:32.475838 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.475798    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9539cc_a539_4ef1_b742_f971f715382e.slice/crio-9fea0a9ea7f80c5a4875f557838acb56c7a97c2c08feae70305113d6e740a31b WatchSource:0}: Error finding container 9fea0a9ea7f80c5a4875f557838acb56c7a97c2c08feae70305113d6e740a31b: Status 404 returned error can't find the container with id 9fea0a9ea7f80c5a4875f557838acb56c7a97c2c08feae70305113d6e740a31b
Jul 07 18:44:32.477356 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:44:32.476927    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c118053_9794_435c_b760_07e63fdd2f9a.slice/crio-9c6febd988894e77c177aae1e29926bec58840824b979e25762b6b9a1f122207 WatchSource:0}: Error finding container 9c6febd988894e77c177aae1e29926bec58840824b979e25762b6b9a1f122207: Status 404 returned error can't find the container with id 9c6febd988894e77c177aae1e29926bec58840824b979e25762b6b9a1f122207
Jul 07 18:44:32.649722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.649688    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:32.649888 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.649747    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:32.649888 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.649852    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:32.649989 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.649888    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:32.649989 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.649920    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:44:33.649900288 +0000 UTC m=+4.066192242 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:32.649989 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.649948    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:33.649931229 +0000 UTC m=+4.066223183 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:32.750396 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.750265    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:32.750493 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.750419    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:32.750493 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.750438    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:32.750493 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.750447    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:32.750493 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:32.750492    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:33.750478074 +0000 UTC m=+4.166770029 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:32.979965 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.979892    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:39:31 +0000 UTC" deadline="2027-12-03 23:40:06.466051601 +0000 UTC"
Jul 07 18:44:32.979965 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:32.979964    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12340h55m33.486093053s"
Jul 07 18:44:33.070960 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.070859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:33.071109 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.070978    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:33.110967 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.110932    2578 generic.go:356] "Generic (PLEG): container finished" podID="856cf93bbd03080e7dae3757ea4a90e5" containerID="59d4dbb12b423a4fa30d49a976ed4c5c2f8e690e96f664e2c1871436becbdd4b" exitCode=0
Jul 07 18:44:33.111601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.111573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal" event={"ID":"856cf93bbd03080e7dae3757ea4a90e5","Type":"ContainerDied","Data":"59d4dbb12b423a4fa30d49a976ed4c5c2f8e690e96f664e2c1871436becbdd4b"}
Jul 07 18:44:33.125574 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.125546    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerStarted","Data":"6b59feee7d97ea14e9957f1e18dbb71cae814deeb047f143294d7bca104718aa"}
Jul 07 18:44:33.131195 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.131109    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl" event={"ID":"4fcec571-83b3-4cf2-9648-2920fda6f1ab","Type":"ContainerStarted","Data":"ec950f9205b906953aab6a62a87c00e051b8f0d0e50b7589559581856d0209c4"}
Jul 07 18:44:33.138603 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.138538    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gzt2" event={"ID":"5d007671-051a-4cae-8609-94302754e98a","Type":"ContainerStarted","Data":"81fbb9bf25ea7734d6a92e98b81df5e5fc842d8cbcff87e745fcfa5fc232d41e"}
Jul 07 18:44:33.144826 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.144800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wprfc" event={"ID":"6c118053-9794-435c-b760-07e63fdd2f9a","Type":"ContainerStarted","Data":"9c6febd988894e77c177aae1e29926bec58840824b979e25762b6b9a1f122207"}
Jul 07 18:44:33.152945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.152922    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cqcg" event={"ID":"7c9539cc-a539-4ef1-b742-f971f715382e","Type":"ContainerStarted","Data":"9fea0a9ea7f80c5a4875f557838acb56c7a97c2c08feae70305113d6e740a31b"}
Jul 07 18:44:33.157477 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.157449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzzmb" event={"ID":"0678dc6a-a5ef-4488-8d21-671bb7048a74","Type":"ContainerStarted","Data":"34fa7954029a3a03477760c32d034a00c9dc21f648007a06510762c36307ada9"}
Jul 07 18:44:33.170174 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.170146    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pxr8" event={"ID":"93495985-21a5-4fd5-aaa8-2a22912a2f20","Type":"ContainerStarted","Data":"e781eece33a32a60c7d4491d8c04b05110967637cd709c51a962c00f70c01608"}
Jul 07 18:44:33.182638 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.182610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"57e300967f0291cbb55a62155873b3a4d07f0ddb150d03a0aa8b20e75ae7323b"}
Jul 07 18:44:33.186343 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.186317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2tpp" event={"ID":"623ea161-df1c-46b0-814a-33c155e98c21","Type":"ContainerStarted","Data":"9b957c203fa0a33d2c6af556dce98108437fa86e6d82ae51c6b96f68f1b9a242"}
Jul 07 18:44:33.660069 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.660024    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:33.660322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.660096    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:33.660322 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.660247    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:33.660322 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.660305    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:44:35.660288868 +0000 UTC m=+6.076580821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:33.660751 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.660705    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:33.660856 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.660762    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:35.660745123 +0000 UTC m=+6.077037091 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:33.761226 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.761177    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:33.761391 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.761381    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:33.761460 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.761399    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:33.761460 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.761411    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:33.761568 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:33.761467    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:35.761449628 +0000 UTC m=+6.177741582 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:33.980654 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.980488    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 18:39:31 +0000 UTC" deadline="2028-04-16 09:13:42.119571584 +0000 UTC"
Jul 07 18:44:33.980654 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:33.980526    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15566h29m8.13905061s"
Jul 07 18:44:34.065363 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:34.065313    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:34.065533 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:34.065452    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:34.066077 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:34.065844    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:34.066077 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:34.065956    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:34.203056 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:34.203018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal" event={"ID":"856cf93bbd03080e7dae3757ea4a90e5","Type":"ContainerStarted","Data":"974ef47647bab1e9bcd0b0e436689390642eac4bb18e0402fc031f16b8789e12"}
Jul 07 18:44:35.064568 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:35.064533    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:35.065045 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.064682    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:35.676271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:35.676222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:35.676271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:35.676273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:35.676565 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.676402    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:35.676565 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.676456    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:44:39.67644256 +0000 UTC m=+10.092734511 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:35.676881 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.676795    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:35.676881 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.676867    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:39.676849649 +0000 UTC m=+10.093141604 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:35.777101 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:35.777062    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:35.777294 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.777246    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:35.777294 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.777273    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:35.777294 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.777286    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:35.777456 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:35.777347    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:39.777328416 +0000 UTC m=+10.193620390 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:36.069161 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:36.069044    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:36.069609 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:36.069172    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:36.069609 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:36.069515    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:36.069745 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:36.069697    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:37.064616 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:37.064580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:37.064799 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:37.064738    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:38.064709 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:38.064628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:38.065200 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:38.064789    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:38.065200 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:38.064847    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:38.065200 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:38.064982    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:39.064843 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:39.064799    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:39.065293 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.064935    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:39.709891 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:39.709857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:39.710076 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:39.709921    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:39.710076 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.710022    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:39.710351 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.710106    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:47.710084798 +0000 UTC m=+18.126376764 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:39.710351 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.710022    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:39.710351 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.710149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:44:47.710140513 +0000 UTC m=+18.126432465 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:39.810966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:39.810926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:39.811155 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.811114    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:39.811155 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.811132    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:39.811155 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.811145    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:39.811324 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:39.811200    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:44:47.811182084 +0000 UTC m=+18.227474055 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:40.065907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:40.065828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:40.066408 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:40.065955    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:40.066408 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:40.066376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:40.066516 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:40.066483    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:41.064973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:41.064492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:41.064973 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:41.064623    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:42.065011 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:42.064973    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:42.065514 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:42.065125    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:42.065514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:42.065178    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:42.065514 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:42.065297    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:43.065358 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.065124    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:43.065810 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:43.065466    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:43.227006 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.226966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rzzmb" event={"ID":"0678dc6a-a5ef-4488-8d21-671bb7048a74","Type":"ContainerStarted","Data":"13e9b7dedd22b00d2bdd1961960e8928897df818bf4671c845a843b4ba3b543b"}
Jul 07 18:44:43.229194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.229163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-h2tpp" event={"ID":"623ea161-df1c-46b0-814a-33c155e98c21","Type":"ContainerStarted","Data":"922bf99f1a6baf417ffc3f70ebae774ee576396c2cfeae7e6865bf6a553bc45f"}
Jul 07 18:44:43.233144 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.232295    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="c705fa8e21b42286a953e17d83eed5f1111a447c4b5285e70a8710c7a1f18cef" exitCode=0
Jul 07 18:44:43.233144 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.232370    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"c705fa8e21b42286a953e17d83eed5f1111a447c4b5285e70a8710c7a1f18cef"}
Jul 07 18:44:43.235981 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.235948    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl" event={"ID":"4fcec571-83b3-4cf2-9648-2920fda6f1ab","Type":"ContainerStarted","Data":"56abf504b2ffd43837ff07b99e6889bc3ca1bf44afe6904ba91f5cf03a457a43"}
Jul 07 18:44:43.238125 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.237808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6gzt2" event={"ID":"5d007671-051a-4cae-8609-94302754e98a","Type":"ContainerStarted","Data":"9d6e91010d13601b834bed732a4b0cd2406933f4b874539cc563db1ca6850f15"}
Jul 07 18:44:43.239787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.239737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-9cqcg" event={"ID":"7c9539cc-a539-4ef1-b742-f971f715382e","Type":"ContainerStarted","Data":"1ac9f9a1ca4a31330e2f333648cb598d18ef21c2bf5c9132370f3115b59eeef6"}
Jul 07 18:44:43.243194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.243149    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rzzmb" podStartSLOduration=3.231964211 podStartE2EDuration="13.24313405s" totalImagesPullingTime="10.011169839s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:43.242908481 +0000 UTC m=+13.659200455" watchObservedRunningTime="2026-07-07 18:44:43.24313405 +0000 UTC m=+13.659426027"
Jul 07 18:44:43.243322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.243297    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-88.ec2.internal" podStartSLOduration=12.243288999 podStartE2EDuration="12.243288999s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:34.222986013 +0000 UTC m=+4.639277992" watchObservedRunningTime="2026-07-07 18:44:43.243288999 +0000 UTC m=+13.659580974"
Jul 07 18:44:43.279412 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.279326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-h2tpp" podStartSLOduration=3.254669885 podStartE2EDuration="13.27931249s" totalImagesPullingTime="10.024642605s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:43.279135979 +0000 UTC m=+13.695427966" watchObservedRunningTime="2026-07-07 18:44:43.27931249 +0000 UTC m=+13.695604462"
Jul 07 18:44:43.296907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.296853    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-9cqcg" podStartSLOduration=3.043000336 podStartE2EDuration="13.296833575s" totalImagesPullingTime="10.253833239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:43.29637336 +0000 UTC m=+13.712665334" watchObservedRunningTime="2026-07-07 18:44:43.296833575 +0000 UTC m=+13.713125550"
Jul 07 18:44:43.312787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:43.312584    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6gzt2" podStartSLOduration=3.316470899 podStartE2EDuration="13.312564906s" totalImagesPullingTime="9.996094007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:43.312244397 +0000 UTC m=+13.728536370" watchObservedRunningTime="2026-07-07 18:44:43.312564906 +0000 UTC m=+13.728856883"
Jul 07 18:44:44.065106 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.065075    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:44.065277 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.065111    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:44.065277 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:44.065196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:44.065402 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:44.065317    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:44.243974 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.243935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8pxr8" event={"ID":"93495985-21a5-4fd5-aaa8-2a22912a2f20","Type":"ContainerStarted","Data":"b6eeab78eff585388a02fd2a1564e733bb92d3625a86fc5aa0dd5f45539dca47"}
Jul 07 18:44:44.765459 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.765428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:44.766336 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.766313    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:44.783909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:44.783860    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8pxr8" podStartSLOduration=4.764318691 podStartE2EDuration="14.783840433s" totalImagesPullingTime="10.019521742s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:44.265005689 +0000 UTC m=+14.681297662" watchObservedRunningTime="2026-07-07 18:44:44.783840433 +0000 UTC m=+15.200132406"
Jul 07 18:44:45.064932 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:45.064852    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:45.065082 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:45.064971    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:46.064748 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:46.064702    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:46.064748 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:46.064708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:46.065342 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:46.064954    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:46.065342 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:46.065096    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:46.247891 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:46.247856    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:44:47.065440 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:47.065405    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:47.066124 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.065529    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:47.774065 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:47.774023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:47.774260 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:47.774087    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:47.774260 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.774211    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:47.774360 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.774279    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:03.774264927 +0000 UTC m=+34.190556882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:44:47.774360 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.774211    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:47.774454 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.774372    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:45:03.774355689 +0000 UTC m=+34.190647642 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:44:47.874749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:47.874710    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:47.874914 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.874863    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:44:47.874914 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.874891    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:44:47.874914 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.874905    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:47.875084 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:47.874968    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:03.874947575 +0000 UTC m=+34.291239543 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:44:48.068667 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:48.068493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:48.068667 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:48.068606    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:48.069320 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:48.068670    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:48.069320 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:48.068796    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:49.064961 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:49.064925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:49.065120 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:49.065049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:49.890903 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:49.890868    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:49.985246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:49.985212    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:50.065633 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:50.065591    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:50.065811 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:50.065733    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:50.065811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:50.065771    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:50.065938 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:50.065848    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:51.064737 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:51.064707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:51.065191 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:51.064818    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:51.529201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:51.528981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:51.596133 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:51.595997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:52.067577 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:52.067549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:52.068029 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:52.067588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:52.068029 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:52.067683    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:52.068029 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:52.067717    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:52.068029 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:52.067772    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:52.068029 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:52.067876    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:54.065182 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:54.065141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:54.065563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:54.065141    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:54.065563 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:54.065270    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:54.065563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:54.065284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:54.065563 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:54.065364    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:54.065563 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:54.065456    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:54.410310 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:54.410264    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 18:44:55.000275 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.000005    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T18:44:54.410289117Z","UUID":"cf1d2221-8f71-483d-b08c-15f942ba2edd","Handler":null,"Name":"","Endpoint":""}
Jul 07 18:44:55.001813 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.001796    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 18:44:55.001919 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.001829    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 18:44:55.266632 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.266598    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal" event={"ID":"ad95ec8a8c8db5b9207b4526a1564dff","Type":"ContainerStarted","Data":"0a6eacdf6998997e258de374acacdac955690d118c2015c386e994be524249f4"}
Jul 07 18:44:55.268318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.268292    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="6ef668a1cd8217d04e92708d2061353bb2f6acdf0dcdd41ebd9a465e9d4c5047" exitCode=0
Jul 07 18:44:55.268451 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.268376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"6ef668a1cd8217d04e92708d2061353bb2f6acdf0dcdd41ebd9a465e9d4c5047"}
Jul 07 18:44:55.270226 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.270204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl" event={"ID":"4fcec571-83b3-4cf2-9648-2920fda6f1ab","Type":"ContainerStarted","Data":"23f94d330b1dc65254f6dddec22183bc2a90eaa883bcf14967a03c399bbfdcf2"}
Jul 07 18:44:55.271725 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.271705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-wprfc" event={"ID":"6c118053-9794-435c-b760-07e63fdd2f9a","Type":"ContainerStarted","Data":"2026c8eb2a0859a70faf56a025a1993787d6200cbb9e8c19a84869ecfecf31ec"}
Jul 07 18:44:55.274548 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"0dbbadad00180777b215b9596186e602e3cd104686c3795fb2158e3ed765e10a"}
Jul 07 18:44:55.274624 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"84725795933ded1dff666213c7cfe7e74b1821cc956db76bf98d19ed660673cc"}
Jul 07 18:44:55.274624 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"ba5ab581f0ad25b0e4497794d3c4fc9594b76af29b7880cbf17c4ef7c2d9a1e2"}
Jul 07 18:44:55.274713 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"819280afb151acca8f212a707b8022c19624b92028501e57a894f48b49993c34"}
Jul 07 18:44:55.274713 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"f4639651880ebee93f98f559c9324830a4033ff591a9271eecc2a8cccc5b07a6"}
Jul 07 18:44:55.274778 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.274719    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"e3d7adca8f1b12f88af35ada14afe63fabb8f50e79832885867c0491554d1d9c"}
Jul 07 18:44:55.282960 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.282927    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-88.ec2.internal" podStartSLOduration=24.282916395 podStartE2EDuration="24.282916395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:55.282698469 +0000 UTC m=+25.698990442" watchObservedRunningTime="2026-07-07 18:44:55.282916395 +0000 UTC m=+25.699208367"
Jul 07 18:44:55.302062 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.302024    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-wprfc" podStartSLOduration=3.821279594 podStartE2EDuration="25.302011161s" totalImagesPullingTime="21.480731567s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:55.301488579 +0000 UTC m=+25.717780552" watchObservedRunningTime="2026-07-07 18:44:55.302011161 +0000 UTC m=+25.718303134"
Jul 07 18:44:55.426636 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.426598    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:55.526068 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:55.525993    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:56.068555 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:56.068482    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:56.068758 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:56.068593    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:56.068758 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:56.068605    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:56.068758 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:56.068626    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:56.068758 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:56.068729    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:56.068938 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:56.068799    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:56.278113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:56.278061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl" event={"ID":"4fcec571-83b3-4cf2-9648-2920fda6f1ab","Type":"ContainerStarted","Data":"632279deb94909356ca5d9e61e83f26bff850488cffe42b00b98efeea0970c98"}
Jul 07 18:44:57.281900 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.281871    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="1b227a75304bbf51e6ff82390d3013c2b9de8baaaa3ddfb1af97ac79541b5990" exitCode=0
Jul 07 18:44:57.282481 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.281952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"1b227a75304bbf51e6ff82390d3013c2b9de8baaaa3ddfb1af97ac79541b5990"}
Jul 07 18:44:57.285402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.285378    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"83ddf2a43d741f4baf0d822a6ca24d8b4e1d3139d8e3401bd0b447983605af5c"}
Jul 07 18:44:57.322494 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.322452    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-x8thl" podStartSLOduration=4.57232628 podStartE2EDuration="27.322436248s" totalImagesPullingTime="22.750109968s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:56.297874614 +0000 UTC m=+26.714166587" watchObservedRunningTime="2026-07-07 18:44:57.322436248 +0000 UTC m=+27.738728223"
Jul 07 18:44:57.914420 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.914383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:57.914616 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.914540    2578 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jul 07 18:44:57.915201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.915033    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6gzt2"
Jul 07 18:44:57.992389 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:57.992357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.064512 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.064484    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:44:58.064678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.064489    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:44:58.064678 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:58.064579    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:44:58.064759 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:58.064675    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:44:58.064759 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.064738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:44:58.064819 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:44:58.064808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:44:58.412060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.412031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.521485 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.521450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.614046 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.613980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.711271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.711241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.778612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.778584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:58.917490 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:58.917460    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:59.013136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.013110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:59.295284 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.295041    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" event={"ID":"a6c638e6-f285-4ecc-89db-615cf11511da","Type":"ContainerStarted","Data":"ac02dada7decb84301004ab9d598bf0193d3e21f24a6630e66844d92959df118"}
Jul 07 18:44:59.295531 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.295354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:59.295531 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.295404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:59.297692 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.297666    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="33b3aa94905aa67a944fa499a14d40c591b060e72e6cef3d4ef0ad77410e3e2b" exitCode=0
Jul 07 18:44:59.297818 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.297716    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"33b3aa94905aa67a944fa499a14d40c591b060e72e6cef3d4ef0ad77410e3e2b"}
Jul 07 18:44:59.311949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.311931    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:44:59.334451 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.334407    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv" podStartSLOduration=8.249974465 podStartE2EDuration="29.334393923s" totalImagesPullingTime="21.084419458s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:44:59.333680243 +0000 UTC m=+29.749972208" watchObservedRunningTime="2026-07-07 18:44:59.334393923 +0000 UTC m=+29.750685896"
Jul 07 18:44:59.375448 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.375425    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:59.761940 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.761892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:44:59.862504 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:44:59.862468    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:00.066167 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.066080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:00.066329 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.066194    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:00.066329 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:00.066197    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:45:00.066329 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.066219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:00.066329 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:00.066312    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:45:00.066519 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:00.066424    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:45:00.300183 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.300152    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:45:00.319068 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.318986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:45:00.555373 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.555331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:00.620117 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:00.620030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:01.074798 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.074765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:01.178524 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.178446    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:01.450097 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.450057    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckp45"]
Jul 07 18:45:01.450263 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.450225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:01.450360 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:01.450339    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:45:01.450944 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.450921    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xv6n4"]
Jul 07 18:45:01.451066 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.451005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:01.451126 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:01.451093    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:45:01.452183 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.452164    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rc6rs"]
Jul 07 18:45:01.452276 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:01.452237    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:01.452328 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:01.452312    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:45:03.064813 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.064774    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:03.065268 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.064821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:03.065268 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.064878    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:45:03.065268 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.064936    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:03.065268 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.065035    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:45:03.065268 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.065144    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:45:03.803922 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.803882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:03.804104 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.803940    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:03.804104 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.804050    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:45:03.804208 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.804111    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:35.804098055 +0000 UTC m=+66.220390011 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 18:45:03.804208 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.804051    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 18:45:03.804208 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.804180    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret podName:5a2b99a6-1e1c-4212-a3dc-f94f615bffaf nodeName:}" failed. No retries permitted until 2026-07-07 18:45:35.804169607 +0000 UTC m=+66.220461557 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret") pod "global-pull-secret-syncer-ckp45" (UID: "5a2b99a6-1e1c-4212-a3dc-f94f615bffaf") : object "kube-system"/"original-pull-secret" not registered
Jul 07 18:45:03.904760 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:03.904720    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:03.904932 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.904872    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 18:45:03.904932 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.904894    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 18:45:03.904932 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.904905    2578 projected.go:196] Error preparing data for projected volume kube-api-access-qkjsx for pod openshift-network-diagnostics/network-check-target-xv6n4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:45:03.905079 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:03.904963    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx podName:4546404c-f210-4cdd-8a84-f1382a4b8e35 nodeName:}" failed. No retries permitted until 2026-07-07 18:45:35.904944115 +0000 UTC m=+66.321236068 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-qkjsx" (UniqueName: "kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx") pod "network-check-target-xv6n4" (UID: "4546404c-f210-4cdd-8a84-f1382a4b8e35") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 18:45:05.064765 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:05.064559    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:05.065205 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:05.064562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:05.065205 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:05.064847    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-ckp45" podUID="5a2b99a6-1e1c-4212-a3dc-f94f615bffaf"
Jul 07 18:45:05.065205 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:05.064566    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:05.065205 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:05.064930    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xv6n4" podUID="4546404c-f210-4cdd-8a84-f1382a4b8e35"
Jul 07 18:45:05.065205 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:05.065024    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rc6rs" podUID="0edc73fa-0c68-40aa-81c3-08153894f4e5"
Jul 07 18:45:05.314599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:05.314568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerStarted","Data":"8af7566745f50fa90dd947919065f2e8ed28ced5fbe87fbb44628a3dded33bc9"}
Jul 07 18:45:06.319242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.319207    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="8af7566745f50fa90dd947919065f2e8ed28ced5fbe87fbb44628a3dded33bc9" exitCode=0
Jul 07 18:45:06.319706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.319247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"8af7566745f50fa90dd947919065f2e8ed28ced5fbe87fbb44628a3dded33bc9"}
Jul 07 18:45:06.913122 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.913094    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-88.ec2.internal" event="NodeReady"
Jul 07 18:45:06.913281 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.913220    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 18:45:06.959022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.958949    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-n4rjd"]
Jul 07 18:45:06.979376 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.979331    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sw6rt"]
Jul 07 18:45:06.979553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.979463    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:06.982045 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.982025    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgd5v\""
Jul 07 18:45:06.982240 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.982226    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 18:45:06.982288 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.982255    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 18:45:06.999539 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.999513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4rjd"]
Jul 07 18:45:06.999694 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.999547    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sw6rt"]
Jul 07 18:45:06.999694 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:06.999619    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.002432 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.002411    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-w2mm7\""
Jul 07 18:45:07.002549 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.002442    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 18:45:07.002622 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.002579    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 18:45:07.002698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.002685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 18:45:07.064560 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.064526    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:07.064758 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.064573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:07.064758 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.064622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:07.067692 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:45:07.067842 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067819    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:45:07.067953 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067917    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdqwt\""
Jul 07 18:45:07.068012 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067951    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:45:07.068012 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067952    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:45:07.068012 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.067974    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gxh7\""
Jul 07 18:45:07.128350 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128320    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a072962-d98d-4f73-97f2-ee60f69c2f6a-tmp-dir\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.128522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128363    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-cert\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.128522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128385    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a072962-d98d-4f73-97f2-ee60f69c2f6a-config-volume\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.128522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt69d\" (UniqueName: \"kubernetes.io/projected/0a072962-d98d-4f73-97f2-ee60f69c2f6a-kube-api-access-rt69d\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.128522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128463    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wll\" (UniqueName: \"kubernetes.io/projected/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-kube-api-access-l5wll\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.128522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.128478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.228936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a072962-d98d-4f73-97f2-ee60f69c2f6a-config-volume\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.228973    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt69d\" (UniqueName: \"kubernetes.io/projected/0a072962-d98d-4f73-97f2-ee60f69c2f6a-kube-api-access-rt69d\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229141 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wll\" (UniqueName: \"kubernetes.io/projected/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-kube-api-access-l5wll\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.229141 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229237 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:07.229139    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:07.229237 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a072962-d98d-4f73-97f2-ee60f69c2f6a-tmp-dir\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229237 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:07.229192    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:07.729175154 +0000 UTC m=+38.145467126 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:07.229386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229246    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-cert\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.229513 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a072962-d98d-4f73-97f2-ee60f69c2f6a-tmp-dir\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.229613 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.229595    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0a072962-d98d-4f73-97f2-ee60f69c2f6a-config-volume\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.233314 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.233284    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-cert\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.238554 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.238529    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt69d\" (UniqueName: \"kubernetes.io/projected/0a072962-d98d-4f73-97f2-ee60f69c2f6a-kube-api-access-rt69d\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.238661 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.238618    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wll\" (UniqueName: \"kubernetes.io/projected/47c4802f-90f8-4c0e-a7a0-c72beb7e05e1-kube-api-access-l5wll\") pod \"ingress-canary-sw6rt\" (UID: \"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1\") " pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.307387 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.307364    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sw6rt"
Jul 07 18:45:07.324136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.324111    2578 generic.go:356] "Generic (PLEG): container finished" podID="a5fa7945-735b-41c9-8cb3-8ffe4680d298" containerID="0f126d1cec726872442f1c7407f234b47b864636659fdb2f585d5395d7cbcf42" exitCode=0
Jul 07 18:45:07.324719 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.324169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerDied","Data":"0f126d1cec726872442f1c7407f234b47b864636659fdb2f585d5395d7cbcf42"}
Jul 07 18:45:07.519838 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.519559    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sw6rt"]
Jul 07 18:45:07.523317 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:45:07.523289    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47c4802f_90f8_4c0e_a7a0_c72beb7e05e1.slice/crio-5845b6e4e5ccce37926f6f4dd15035eca48ce41e30b0a3e98256580cca71322e WatchSource:0}: Error finding container 5845b6e4e5ccce37926f6f4dd15035eca48ce41e30b0a3e98256580cca71322e: Status 404 returned error can't find the container with id 5845b6e4e5ccce37926f6f4dd15035eca48ce41e30b0a3e98256580cca71322e
Jul 07 18:45:07.669702 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.669673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:07.734024 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:07.733981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:07.734198 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:07.734141    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:07.734249 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:07.734207    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:08.734191187 +0000 UTC m=+39.150483137 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:08.330719 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.330685    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-d89ld" event={"ID":"a5fa7945-735b-41c9-8cb3-8ffe4680d298","Type":"ContainerStarted","Data":"9af9cf72be22b7fa163ebb9b69c2859e701b39a41c70a667a371b284918ff16f"}
Jul 07 18:45:08.331926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.331893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sw6rt" event={"ID":"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1","Type":"ContainerStarted","Data":"5845b6e4e5ccce37926f6f4dd15035eca48ce41e30b0a3e98256580cca71322e"}
Jul 07 18:45:08.358417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.358366    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-d89ld" podStartSLOduration=9.131297331 podStartE2EDuration="38.358348291s" totalImagesPullingTime="29.22705096s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:08.357628116 +0000 UTC m=+38.773920100" watchObservedRunningTime="2026-07-07 18:45:08.358348291 +0000 UTC m=+38.774640268"
Jul 07 18:45:08.483181 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.483142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:08.562907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.562875    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:08.740806 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:08.740769    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:08.740949 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:08.740909    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:08.740991 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:08.740968    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:10.740952383 +0000 UTC m=+41.157244334 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:10.437660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:10.437613    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:10.495331 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:10.495298    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:10.754201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:10.753954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:10.754353 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:10.754106    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:10.754353 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:10.754277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:14.754254753 +0000 UTC m=+45.170546706 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:11.340266 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:11.340233    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sw6rt" event={"ID":"47c4802f-90f8-4c0e-a7a0-c72beb7e05e1","Type":"ContainerStarted","Data":"fad9032efabcf3e16e9dfffe517ff370903ea70e65590b3bdb1b1f79e1947efc"}
Jul 07 18:45:11.361310 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:11.359317    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sw6rt" podStartSLOduration=2.272748222 podStartE2EDuration="5.359264419s" totalImagesPullingTime="3.086516197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:11.358123382 +0000 UTC m=+41.774415346" watchObservedRunningTime="2026-07-07 18:45:11.359264419 +0000 UTC m=+41.775556396"
Jul 07 18:45:12.833354 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:12.833314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:12.932899 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:12.932870    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:13.839570 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:13.839514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:13.902322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:13.902292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:14.781316 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:14.781282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:14.781459 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:14.781392    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:14.781459 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:14.781444    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:22.781430007 +0000 UTC m=+53.197721958 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:16.664784 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:16.664751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:16.765796 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:16.765758    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:16.823236 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:16.823205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:22.833338 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:22.833292    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:22.833826 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:22.833440    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:22.833826 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:22.833512    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:45:38.833495073 +0000 UTC m=+69.249787029 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:23.850371 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:23.850329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:23.950799 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:23.950762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:24.053043 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:24.053004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:30.911726 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:30.911693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:32.166394 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:32.166356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:32.314911 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:32.314883    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hvjjv"
Jul 07 18:45:32.474940 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:32.474848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:32.532023 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:32.531995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:35.822699 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.822634    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:45:35.823170 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.822788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:35.825784 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.825761    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 18:45:35.825784 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.825778    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 18:45:35.833236 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:35.833217    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 18:45:35.833291 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:35.833281    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs podName:0edc73fa-0c68-40aa-81c3-08153894f4e5 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:39.833263048 +0000 UTC m=+130.249554999 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs") pod "network-metrics-daemon-rc6rs" (UID: "0edc73fa-0c68-40aa-81c3-08153894f4e5") : secret "metrics-daemon-secret" not found
Jul 07 18:45:35.837004 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.836971    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5a2b99a6-1e1c-4212-a3dc-f94f615bffaf-original-pull-secret\") pod \"global-pull-secret-syncer-ckp45\" (UID: \"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf\") " pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:35.884044 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.884012    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-ckp45"
Jul 07 18:45:35.923119 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.923084    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:35.926195 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.926175    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 18:45:35.936742 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.936716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 18:45:35.947055 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:35.947021    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qkjsx\" (UniqueName: \"kubernetes.io/projected/4546404c-f210-4cdd-8a84-f1382a4b8e35-kube-api-access-qkjsx\") pod \"network-check-target-xv6n4\" (UID: \"4546404c-f210-4cdd-8a84-f1382a4b8e35\") " pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:36.048808 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.048778    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-ckp45"]
Jul 07 18:45:36.051899 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:45:36.051867    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a2b99a6_1e1c_4212_a3dc_f94f615bffaf.slice/crio-16093f378bc5b41113a484965da46f2fadec2e798ac6c68a5b5c79e54ed78e54 WatchSource:0}: Error finding container 16093f378bc5b41113a484965da46f2fadec2e798ac6c68a5b5c79e54ed78e54: Status 404 returned error can't find the container with id 16093f378bc5b41113a484965da46f2fadec2e798ac6c68a5b5c79e54ed78e54
Jul 07 18:45:36.176625 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.176598    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-vdqwt\""
Jul 07 18:45:36.184069 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.184042    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:36.334401 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.334370    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xv6n4"]
Jul 07 18:45:36.337540 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:45:36.337520    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4546404c_f210_4cdd_8a84_f1382a4b8e35.slice/crio-543a2d998e4e659060c7c4bbd93dafb638bb4692aa22e6a8e9d2bc27cc05d966 WatchSource:0}: Error finding container 543a2d998e4e659060c7c4bbd93dafb638bb4692aa22e6a8e9d2bc27cc05d966: Status 404 returned error can't find the container with id 543a2d998e4e659060c7c4bbd93dafb638bb4692aa22e6a8e9d2bc27cc05d966
Jul 07 18:45:36.396972 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.396930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xv6n4" event={"ID":"4546404c-f210-4cdd-8a84-f1382a4b8e35","Type":"ContainerStarted","Data":"543a2d998e4e659060c7c4bbd93dafb638bb4692aa22e6a8e9d2bc27cc05d966"}
Jul 07 18:45:36.397996 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.397972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckp45" event={"ID":"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf","Type":"ContainerStarted","Data":"16093f378bc5b41113a484965da46f2fadec2e798ac6c68a5b5c79e54ed78e54"}
Jul 07 18:45:36.921506 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.921473    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:36.979488 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:36.979424    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:37.442783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:37.442702    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:37.501038 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:37.500971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:38.843936 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:38.843885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:45:38.844358 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:38.844086    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:45:38.844358 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:45:38.844163    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:46:10.844140534 +0000 UTC m=+101.260432488 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:45:41.412481 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:41.412445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xv6n4" event={"ID":"4546404c-f210-4cdd-8a84-f1382a4b8e35","Type":"ContainerStarted","Data":"4fe54a7dad9aa5984141556d1cc7c682de7743f9ffb00b064f1a6a2d1941b445"}
Jul 07 18:45:41.412969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:41.412543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:45:41.413955 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:41.413935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-ckp45" event={"ID":"5a2b99a6-1e1c-4212-a3dc-f94f615bffaf","Type":"ContainerStarted","Data":"250348e64ae8a5aef625fa8a5a90349f17f09aa1fd0ed6f3932eb377e55b8bc8"}
Jul 07 18:45:41.430176 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:41.430132    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xv6n4" podStartSLOduration=66.706012393 podStartE2EDuration="1m11.4301185s" totalImagesPullingTime="4.724106107s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:41.429788089 +0000 UTC m=+71.846080064" watchObservedRunningTime="2026-07-07 18:45:41.4301185 +0000 UTC m=+71.846410451"
Jul 07 18:45:46.004205 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:46.004172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:45:46.061250 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:45:46.061218    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:01.891326 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:01.891208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:01.953417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:01.953381    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:02.016875 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:02.016851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:04.240837 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.240788    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-ckp45" podStartSLOduration=89.230242726 podStartE2EDuration="1m34.240772273s" totalImagesPullingTime="5.010529547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:45:41.444909945 +0000 UTC m=+71.861201918" watchObservedRunningTime="2026-07-07 18:46:04.240772273 +0000 UTC m=+94.657064242"
Jul 07 18:46:04.241556 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.241538    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5966767b69-6jtsc"]
Jul 07 18:46:04.243965 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.243951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.246840 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.246816    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 18:46:04.246943 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.246891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 18:46:04.247207 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.247191    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 18:46:04.247266 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.247245    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 18:46:04.247383 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.247356    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 18:46:04.247535 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.247520    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-75gms\""
Jul 07 18:46:04.247996 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.247982    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 18:46:04.257046 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.257020    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5966767b69-6jtsc"]
Jul 07 18:46:04.321392 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.321356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-stats-auth\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.321559 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.321402    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9rq6\" (UniqueName: \"kubernetes.io/projected/5e183e89-65fd-4109-af6d-5ea306363aa2-kube-api-access-c9rq6\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.321559 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.321424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-default-certificate\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.321559 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.321472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.321696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.321566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.337026 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.336999    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-prf9z"]
Jul 07 18:46:04.338723 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.338708    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.342433 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.342408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 18:46:04.342433 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.342413    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 18:46:04.342604 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.342429    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 18:46:04.342690 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.342676    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-nzlz9\""
Jul 07 18:46:04.342890 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.342874    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 18:46:04.347578 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.347555    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 18:46:04.353487 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.353468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-prf9z"]
Jul 07 18:46:04.394416 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.394384    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:04.422515 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422489    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-default-certificate\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.422515 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.422722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-tmp\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-serving-cert\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l56c5\" (UniqueName: \"kubernetes.io/projected/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-kube-api-access-l56c5\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422664    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.422741    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:04.922715297 +0000 UTC m=+95.339007252 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.422769    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422793    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.422823    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:04.922809707 +0000 UTC m=+95.339101674 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-stats-auth\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422887    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-snapshots\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.422945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.422918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9rq6\" (UniqueName: \"kubernetes.io/projected/5e183e89-65fd-4109-af6d-5ea306363aa2-kube-api-access-c9rq6\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.424987 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.424967    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-default-certificate\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.425195 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.425176    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-stats-auth\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.434916 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.434894    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9rq6\" (UniqueName: \"kubernetes.io/projected/5e183e89-65fd-4109-af6d-5ea306363aa2-kube-api-access-c9rq6\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.496200 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.496114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:04.523791 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.523760    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-tmp\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.523791 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.523792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-serving-cert\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.523992 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.523810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l56c5\" (UniqueName: \"kubernetes.io/projected/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-kube-api-access-l56c5\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.523992 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.523828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524094 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.523999    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524094 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.524045    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-snapshots\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524186 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.524167    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-tmp\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524531 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.524508    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524629 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.524599    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-snapshots\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.524629 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.524619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.526196 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.526168    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-serving-cert\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.534039 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.534015    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l56c5\" (UniqueName: \"kubernetes.io/projected/4b9d926f-f9e6-4a08-88cd-4117d8e59f25-kube-api-access-l56c5\") pod \"insights-operator-5c847dcfc4-prf9z\" (UID: \"4b9d926f-f9e6-4a08-88cd-4117d8e59f25\") " pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.647924 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.647893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z"
Jul 07 18:46:04.769760 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.769675    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-prf9z"]
Jul 07 18:46:04.773559 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:04.773537    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9d926f_f9e6_4a08_88cd_4117d8e59f25.slice/crio-4267793d3d2d50ff716ad477c2230c4e567090d1f7900b7367506da9a845ad28 WatchSource:0}: Error finding container 4267793d3d2d50ff716ad477c2230c4e567090d1f7900b7367506da9a845ad28: Status 404 returned error can't find the container with id 4267793d3d2d50ff716ad477c2230c4e567090d1f7900b7367506da9a845ad28
Jul 07 18:46:04.928519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.928472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.928519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:04.928527    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:04.928754 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.928618    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:04.928754 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.928668    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:05.92862562 +0000 UTC m=+96.344917574 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:04.928754 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:04.928739    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:05.928731918 +0000 UTC m=+96.345023869 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:05.473953 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:05.473912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z" event={"ID":"4b9d926f-f9e6-4a08-88cd-4117d8e59f25","Type":"ContainerStarted","Data":"4267793d3d2d50ff716ad477c2230c4e567090d1f7900b7367506da9a845ad28"}
Jul 07 18:46:05.937099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:05.937060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:05.937285 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:05.937125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:05.937285 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:05.937251    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:07.937229202 +0000 UTC m=+98.353521165 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:05.937407 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:05.937292    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:05.937407 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:05.937344    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:07.937328965 +0000 UTC m=+98.353620930 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:07.480618 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.480577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z" event={"ID":"4b9d926f-f9e6-4a08-88cd-4117d8e59f25","Type":"ContainerStarted","Data":"7cd9195c1a19fe2e62b906d608c06591fc0a3232e9373822269b49af06817133"}
Jul 07 18:46:07.500503 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.500453    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z" podStartSLOduration=1.5456591259999999 podStartE2EDuration="3.500437648s" totalImagesPullingTime="1.954778522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:07.499297505 +0000 UTC m=+97.915589478" watchObservedRunningTime="2026-07-07 18:46:07.500437648 +0000 UTC m=+97.916729656"
Jul 07 18:46:07.952848 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.952801    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:07.953037 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.952872    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:07.953037 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:07.952948    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.952923224 +0000 UTC m=+102.369215176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:07.953037 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:07.953008    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:07.953213 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:07.953066    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.953050145 +0000 UTC m=+102.369342108 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:07.972906 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.972877    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-p6c4v"]
Jul 07 18:46:07.974926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.974911    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:07.977467 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.977443    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 18:46:07.977573 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.977556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 18:46:07.977850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.977835    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htdwq\""
Jul 07 18:46:07.985468 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.985446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p6c4v"]
Jul 07 18:46:07.995142 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:07.995121    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:08.052280 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.052250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:08.054324 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.054299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.054450 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.054342    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5a4b852-9fb0-429f-8873-d2e5da945d94-crio-socket\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.054450 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.054371    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.054450 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.054436    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5a4b852-9fb0-429f-8873-d2e5da945d94-data-volume\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.054563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.054488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tptbk\" (UniqueName: \"kubernetes.io/projected/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-api-access-tptbk\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.155812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.155812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5a4b852-9fb0-429f-8873-d2e5da945d94-crio-socket\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155853    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5a4b852-9fb0-429f-8873-d2e5da945d94-data-volume\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155885    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tptbk\" (UniqueName: \"kubernetes.io/projected/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-api-access-tptbk\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.155924    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a5a4b852-9fb0-429f-8873-d2e5da945d94-crio-socket\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.155931    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.156007    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:08.655990422 +0000 UTC m=+99.072282373 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.156037 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.155948    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.156389 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.156077    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:08.656058629 +0000 UTC m=+99.072350580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.156389 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.156152    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a5a4b852-9fb0-429f-8873-d2e5da945d94-data-volume\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.164622 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.164601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tptbk\" (UniqueName: \"kubernetes.io/projected/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-api-access-tptbk\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.659790 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.659754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.660162 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:08.659798    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:08.660162 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.659876    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.660162 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.659909    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:08.660162 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.659939    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:09.659922059 +0000 UTC m=+100.076214028 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:08.660162 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:08.659958    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:09.659950192 +0000 UTC m=+100.076242143 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:09.667718 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:09.667662    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:09.667718 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:09.667718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:09.668129 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:09.667806    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:09.668129 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:09.667817    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:09.668129 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:09.667855    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.667842963 +0000 UTC m=+102.084134914 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:09.668129 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:09.667879    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:11.667866086 +0000 UTC m=+102.084158037 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:10.146822 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:10.146728    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzzmb_0678dc6a-a5ef-4488-8d21-671bb7048a74/dns-node-resolver/0.log"
Jul 07 18:46:10.747131 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:10.747105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h2tpp_623ea161-df1c-46b0-814a-33c155e98c21/node-ca/0.log"
Jul 07 18:46:10.877972 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:10.877938    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:46:10.878117 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:10.878084    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 18:46:10.878165 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:10.878149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls podName:0a072962-d98d-4f73-97f2-ee60f69c2f6a nodeName:}" failed. No retries permitted until 2026-07-07 18:47:14.878131276 +0000 UTC m=+165.294423226 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls") pod "dns-default-n4rjd" (UID: "0a072962-d98d-4f73-97f2-ee60f69c2f6a") : secret "dns-default-metrics-tls" not found
Jul 07 18:46:11.546968 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:11.546924    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sw6rt_47c4802f-90f8-4c0e-a7a0-c72beb7e05e1/serve-healthcheck-canary/0.log"
Jul 07 18:46:11.682524 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:11.682482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:11.682751 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:11.682600    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:11.682751 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.682624    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:11.682751 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.682728    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:15.682705602 +0000 UTC m=+106.098997553 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:11.682751 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.682728    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:11.682925 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.682768    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:15.682758516 +0000 UTC m=+106.099050470 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:11.984835 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:11.984802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:11.985280 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:11.984898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:11.985280 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.984982    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:11.985280 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.985005    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:19.984990935 +0000 UTC m=+110.401282886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:11.985280 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:11.985056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:19.985037449 +0000 UTC m=+110.401329400 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:12.418515 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:12.418484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xv6n4"
Jul 07 18:46:14.367613 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.367579    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"]
Jul 07 18:46:14.398598 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.398564    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"]
Jul 07 18:46:14.398747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.398701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:14.401606 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.401577    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:46:14.401754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.401624    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 07 18:46:14.401754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.401669    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 07 18:46:14.402794 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.402762    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9xsgj\""
Jul 07 18:46:14.501486 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.501451    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt2wq\" (UniqueName: \"kubernetes.io/projected/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-kube-api-access-tt2wq\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:14.501486 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.501490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:14.602018 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.601980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt2wq\" (UniqueName: \"kubernetes.io/projected/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-kube-api-access-tt2wq\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:14.602210 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.602032    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:14.602263 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:14.602231    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:46:14.602337 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:14.602316    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls podName:aec65942-9b9c-4bc7-acb5-dad9a9ade14b nodeName:}" failed. No retries permitted until 2026-07-07 18:46:15.102294526 +0000 UTC m=+105.518586501 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sj7b" (UID: "aec65942-9b9c-4bc7-acb5-dad9a9ade14b") : secret "samples-operator-tls" not found
Jul 07 18:46:14.611458 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:14.611429    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt2wq\" (UniqueName: \"kubernetes.io/projected/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-kube-api-access-tt2wq\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:15.105545 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:15.105504    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:15.105739 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.105665    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:46:15.105739 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.105733    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls podName:aec65942-9b9c-4bc7-acb5-dad9a9ade14b nodeName:}" failed. No retries permitted until 2026-07-07 18:46:16.105717389 +0000 UTC m=+106.522009343 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sj7b" (UID: "aec65942-9b9c-4bc7-acb5-dad9a9ade14b") : secret "samples-operator-tls" not found
Jul 07 18:46:15.709223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:15.709186    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:15.709599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:15.709231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:15.709599 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.709312    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 18:46:15.709599 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.709344    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:15.709599 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.709380    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:23.709360868 +0000 UTC m=+114.125652839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : configmap "kube-rbac-proxy" not found
Jul 07 18:46:15.709599 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:15.709397    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:23.709386264 +0000 UTC m=+114.125678229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:16.112227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:16.112139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:16.112372 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:16.112295    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:46:16.112372 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:16.112358    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls podName:aec65942-9b9c-4bc7-acb5-dad9a9ade14b nodeName:}" failed. No retries permitted until 2026-07-07 18:46:18.112341604 +0000 UTC m=+108.528633556 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sj7b" (UID: "aec65942-9b9c-4bc7-acb5-dad9a9ade14b") : secret "samples-operator-tls" not found
Jul 07 18:46:16.980141 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:16.980105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:17.296147 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.296062    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:46:17.315518 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.315493    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:46:17.315661 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.315579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.318549 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.318528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 18:46:17.318696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.318548    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jbkl\""
Jul 07 18:46:17.318696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.318569    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 18:46:17.318696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.318556    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 18:46:17.323406 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.323391    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 18:46:17.423524 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423699 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423699 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423778 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423711    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423778 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423729    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423883 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423883 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423804    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.423883 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.423822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-968kh\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524661 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524774    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.524825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.525053 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:17.524882    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:46:17.525053 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:17.524904    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-846d8456d8-9xl86: secret "image-registry-tls" not found
Jul 07 18:46:17.525053 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:17.524960    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls podName:321d1c0f-9a65-4ae7-aa81-9245e6eaf303 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:18.024941924 +0000 UTC m=+108.441233876 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls") pod "image-registry-846d8456d8-9xl86" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303") : secret "image-registry-tls" not found
Jul 07 18:46:17.525053 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.524983    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.525053 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.525013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-968kh\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.525315 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.525294    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.525479 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.525458    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.525681 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.525661    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.527312 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.527289    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.527410 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.527329    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.541725 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.541694    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:17.542351 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:17.542331    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-968kh\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:18.029592 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:18.029552    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:18.030049 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:18.029718    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:46:18.030049 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:18.029738    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-846d8456d8-9xl86: secret "image-registry-tls" not found
Jul 07 18:46:18.030049 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:18.029803    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls podName:321d1c0f-9a65-4ae7-aa81-9245e6eaf303 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:19.029786266 +0000 UTC m=+109.446078216 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls") pod "image-registry-846d8456d8-9xl86" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303") : secret "image-registry-tls" not found
Jul 07 18:46:18.130662 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:18.130615    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:18.130823 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:18.130763    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:46:18.130868 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:18.130836    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls podName:aec65942-9b9c-4bc7-acb5-dad9a9ade14b nodeName:}" failed. No retries permitted until 2026-07-07 18:46:22.130819074 +0000 UTC m=+112.547111045 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sj7b" (UID: "aec65942-9b9c-4bc7-acb5-dad9a9ade14b") : secret "samples-operator-tls" not found
Jul 07 18:46:19.038278 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.038230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:19.038684 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:19.038393    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:46:19.038684 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:19.038413    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-846d8456d8-9xl86: secret "image-registry-tls" not found
Jul 07 18:46:19.038684 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:19.038470    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls podName:321d1c0f-9a65-4ae7-aa81-9245e6eaf303 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:21.038453923 +0000 UTC m=+111.454745874 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls") pod "image-registry-846d8456d8-9xl86" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303") : secret "image-registry-tls" not found
Jul 07 18:46:19.366756 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.366677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:19.467150 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.467117    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:19.569230 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.569203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:19.664078 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.664047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:19.895601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.895567    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:19.964201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:19.964134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:20.046512 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.046479    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:20.046921 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.046565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:20.046921 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:20.046655    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:36.046621696 +0000 UTC m=+126.462913647 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : configmap references non-existent config key: service-ca.crt
Jul 07 18:46:20.046921 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:20.046697    2578 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 18:46:20.046921 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:20.046743    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs podName:5e183e89-65fd-4109-af6d-5ea306363aa2 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:36.046731527 +0000 UTC m=+126.463023478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs") pod "router-default-5966767b69-6jtsc" (UID: "5e183e89-65fd-4109-af6d-5ea306363aa2") : secret "router-metrics-certs-default" not found
Jul 07 18:46:20.372776 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.372688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:20.435306 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.435263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:20.537371 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.537342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:20.842177 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.842146    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"]
Jul 07 18:46:20.844980 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.844965    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"
Jul 07 18:46:20.847623 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.847603    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-t42ql\""
Jul 07 18:46:20.855162 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.855141    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"]
Jul 07 18:46:20.953818 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:20.953787    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-597vx\" (UniqueName: \"kubernetes.io/projected/70509e63-77dc-411c-b580-6b2efa5b835b-kube-api-access-597vx\") pod \"network-check-source-989f8b8dc-s22ql\" (UID: \"70509e63-77dc-411c-b580-6b2efa5b835b\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"
Jul 07 18:46:21.054411 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.054366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-597vx\" (UniqueName: \"kubernetes.io/projected/70509e63-77dc-411c-b580-6b2efa5b835b-kube-api-access-597vx\") pod \"network-check-source-989f8b8dc-s22ql\" (UID: \"70509e63-77dc-411c-b580-6b2efa5b835b\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"
Jul 07 18:46:21.054805 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.054463    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:21.054805 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:21.054564    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:46:21.054805 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:21.054575    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-846d8456d8-9xl86: secret "image-registry-tls" not found
Jul 07 18:46:21.054805 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:21.054615    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls podName:321d1c0f-9a65-4ae7-aa81-9245e6eaf303 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:25.054601552 +0000 UTC m=+115.470893503 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls") pod "image-registry-846d8456d8-9xl86" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303") : secret "image-registry-tls" not found
Jul 07 18:46:21.063248 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.063227    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-597vx\" (UniqueName: \"kubernetes.io/projected/70509e63-77dc-411c-b580-6b2efa5b835b-kube-api-access-597vx\") pod \"network-check-source-989f8b8dc-s22ql\" (UID: \"70509e63-77dc-411c-b580-6b2efa5b835b\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"
Jul 07 18:46:21.154069 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.154036    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"
Jul 07 18:46:21.222393 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.222363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:21.272119 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.272092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql"]
Jul 07 18:46:21.274839 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:21.274807    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70509e63_77dc_411c_b580_6b2efa5b835b.slice/crio-0719188fc76433342d18aade227390eb8bffcbb4e71bf1fb02d2874cd3ca4f9c WatchSource:0}: Error finding container 0719188fc76433342d18aade227390eb8bffcbb4e71bf1fb02d2874cd3ca4f9c: Status 404 returned error can't find the container with id 0719188fc76433342d18aade227390eb8bffcbb4e71bf1fb02d2874cd3ca4f9c
Jul 07 18:46:21.512858 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.512782    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql" event={"ID":"70509e63-77dc-411c-b580-6b2efa5b835b","Type":"ContainerStarted","Data":"425cd8a13c2418ddecf8b27dd400024e5d20f2af752f53fbc3d43badd61a1d39"}
Jul 07 18:46:21.512858 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.512836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql" event={"ID":"70509e63-77dc-411c-b580-6b2efa5b835b","Type":"ContainerStarted","Data":"0719188fc76433342d18aade227390eb8bffcbb4e71bf1fb02d2874cd3ca4f9c"}
Jul 07 18:46:21.521870 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.521846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:21.529706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.529668    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-s22ql" podStartSLOduration=1.52965231 podStartE2EDuration="1.52965231s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:21.528331308 +0000 UTC m=+111.944623282" watchObservedRunningTime="2026-07-07 18:46:21.52965231 +0000 UTC m=+111.945944275"
Jul 07 18:46:21.623406 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:21.623377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:22.069566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:22.069532    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:22.165984 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:22.165948    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:22.166139 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:22.166116    2578 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 07 18:46:22.166213 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:22.166201    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls podName:aec65942-9b9c-4bc7-acb5-dad9a9ade14b nodeName:}" failed. No retries permitted until 2026-07-07 18:46:30.166175236 +0000 UTC m=+120.582467200 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-2sj7b" (UID: "aec65942-9b9c-4bc7-acb5-dad9a9ade14b") : secret "samples-operator-tls" not found
Jul 07 18:46:22.168433 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:22.168399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:22.915340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:22.915311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:23.779389 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:23.779341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:23.779789 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:23.779441    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:23.779789 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:23.779593    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:23.779789 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:23.779676    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls podName:a5a4b852-9fb0-429f-8873-d2e5da945d94 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:39.779659977 +0000 UTC m=+130.195951929 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls") pod "insights-runtime-extractor-p6c4v" (UID: "a5a4b852-9fb0-429f-8873-d2e5da945d94") : secret "insights-runtime-extractor-tls" not found
Jul 07 18:46:23.779936 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:23.779904    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a5a4b852-9fb0-429f-8873-d2e5da945d94-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:23.823356 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:23.823326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:23.948075 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:23.948043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:24.091056 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:24.090984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:24.161495 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:24.161461    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:24.280228 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:24.280189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:24.381892 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:24.381818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:24.521220 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:24.521192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:25.090914 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:25.090883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:25.091382 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:25.091051    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 18:46:25.091382 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:25.091072    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-846d8456d8-9xl86: secret "image-registry-tls" not found
Jul 07 18:46:25.091382 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:25.091149    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls podName:321d1c0f-9a65-4ae7-aa81-9245e6eaf303 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:33.091127368 +0000 UTC m=+123.507419339 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls") pod "image-registry-846d8456d8-9xl86" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303") : secret "image-registry-tls" not found
Jul 07 18:46:25.518100 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:25.518073    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:25.625208 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:25.625158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:25.922836 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:25.922803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:26.135241 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:26.135200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:26.315326 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:26.315248    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:26.719313 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:26.719273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:26.778213 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:26.778177    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:27.207657 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:27.207622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:27.313238 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:27.313211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:27.512426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:27.512339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:27.568834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:27.568792    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:27.716678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:27.716624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:28.124118 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:28.124085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:28.718318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:28.718284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:28.916913 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:28.916879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:29.085867 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:29.085791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:29.145030 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:29.144997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:29.311573 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:29.311544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:29.825315 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:29.825277    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:30.233177 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.233146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:30.235407 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.235381    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/aec65942-9b9c-4bc7-acb5-dad9a9ade14b-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-2sj7b\" (UID: \"aec65942-9b9c-4bc7-acb5-dad9a9ade14b\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:30.312012 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.311988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-9xsgj\""
Jul 07 18:46:30.318813 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.318791    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"
Jul 07 18:46:30.323193 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.323164    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:30.438842 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.438822    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b"]
Jul 07 18:46:30.516513 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.516444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:30.535118 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.535095    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b" event={"ID":"aec65942-9b9c-4bc7-acb5-dad9a9ade14b","Type":"ContainerStarted","Data":"61366b780d0c02df77d5adaa8fe3c5a0d63fbf0027e05162c5a3d5bf16c3b012"}
Jul 07 18:46:30.913565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:30.913535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:31.112814 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:31.112781    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:31.522417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:31.522377    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:32.315599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:32.315564    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:32.515607 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:32.515536    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:32.920625 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:32.920591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:33.131670 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.131576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:33.156571 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.156542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:33.158915 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.158899    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"image-registry-846d8456d8-9xl86\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") " pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:33.227907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.227880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9jbkl\""
Jul 07 18:46:33.235352 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.235332    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:33.358499 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.358470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:46:33.361759 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:33.361735    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321d1c0f_9a65_4ae7_aa81_9245e6eaf303.slice/crio-72f38e93f667a88c673c763d0e89a6155be0429c27026692140f399f2af66cd0 WatchSource:0}: Error finding container 72f38e93f667a88c673c763d0e89a6155be0429c27026692140f399f2af66cd0: Status 404 returned error can't find the container with id 72f38e93f667a88c673c763d0e89a6155be0429c27026692140f399f2af66cd0
Jul 07 18:46:33.523876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.523841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:33.544962 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.544933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b" event={"ID":"aec65942-9b9c-4bc7-acb5-dad9a9ade14b","Type":"ContainerStarted","Data":"d8b246e3f018bbbdd740f49f629cdd1e88066e6b814e602003d4a6f6e63a396f"}
Jul 07 18:46:33.545128 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.544985    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b" event={"ID":"aec65942-9b9c-4bc7-acb5-dad9a9ade14b","Type":"ContainerStarted","Data":"7c43949dc231cf3eeb52e02c88ef2e06ec9bc0f0b9a5683011be9aebd1588987"}
Jul 07 18:46:33.546518 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.546493    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" event={"ID":"321d1c0f-9a65-4ae7-aa81-9245e6eaf303","Type":"ContainerStarted","Data":"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"}
Jul 07 18:46:33.546616 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.546537    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" event={"ID":"321d1c0f-9a65-4ae7-aa81-9245e6eaf303","Type":"ContainerStarted","Data":"72f38e93f667a88c673c763d0e89a6155be0429c27026692140f399f2af66cd0"}
Jul 07 18:46:33.546684 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.546618    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:46:33.562801 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.562761    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-2sj7b" podStartSLOduration=17.198075673 podStartE2EDuration="19.562747613s" totalImagesPullingTime="2.36467194s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:33.562521505 +0000 UTC m=+123.978813477" watchObservedRunningTime="2026-07-07 18:46:33.562747613 +0000 UTC m=+123.979039569"
Jul 07 18:46:33.583095 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:33.583057    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" podStartSLOduration=16.583043181 podStartE2EDuration="16.583043181s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:33.581894217 +0000 UTC m=+123.998186200" watchObservedRunningTime="2026-07-07 18:46:33.583043181 +0000 UTC m=+123.999335158"
Jul 07 18:46:34.112397 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:34.112360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:34.314235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:34.314205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:34.522376 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:34.522341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:36.080062 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.080035    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:36.080429 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.080093    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:36.080696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.080678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5e183e89-65fd-4109-af6d-5ea306363aa2-service-ca-bundle\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:36.082331 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.082314    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5e183e89-65fd-4109-af6d-5ea306363aa2-metrics-certs\") pod \"router-default-5966767b69-6jtsc\" (UID: \"5e183e89-65fd-4109-af6d-5ea306363aa2\") " pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:36.355187 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.355110    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-75gms\""
Jul 07 18:46:36.362706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.362691    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:36.490794 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.490763    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5966767b69-6jtsc"]
Jul 07 18:46:36.493460 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:36.493437    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e183e89_65fd_4109_af6d_5ea306363aa2.slice/crio-8423304fae803646db163f0b5f1c45c459344fce72b43ee0f2db496c260ea436 WatchSource:0}: Error finding container 8423304fae803646db163f0b5f1c45c459344fce72b43ee0f2db496c260ea436: Status 404 returned error can't find the container with id 8423304fae803646db163f0b5f1c45c459344fce72b43ee0f2db496c260ea436
Jul 07 18:46:36.558169 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.558136    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5966767b69-6jtsc" event={"ID":"5e183e89-65fd-4109-af6d-5ea306363aa2","Type":"ContainerStarted","Data":"c32d1131e98952943d9e55f6e064024e7ea4e2ffdedb52d85cd351e1fbba4d79"}
Jul 07 18:46:36.558294 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.558214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5966767b69-6jtsc" event={"ID":"5e183e89-65fd-4109-af6d-5ea306363aa2","Type":"ContainerStarted","Data":"8423304fae803646db163f0b5f1c45c459344fce72b43ee0f2db496c260ea436"}
Jul 07 18:46:36.583655 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:36.583596    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5966767b69-6jtsc" podStartSLOduration=32.583579591 podStartE2EDuration="32.583579591s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:36.581748097 +0000 UTC m=+126.998040070" watchObservedRunningTime="2026-07-07 18:46:36.583579591 +0000 UTC m=+126.999871563"
Jul 07 18:46:37.363941 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:37.363903    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:37.367635 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:37.367612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:37.561660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:37.561613    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:37.562824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:37.562803    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5966767b69-6jtsc"
Jul 07 18:46:38.875376 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:38.875342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:38.974160 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:38.974126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:39.074215 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.074163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:39.176997 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.176967    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:39.811945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.811910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:39.814137 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.814114    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a5a4b852-9fb0-429f-8873-d2e5da945d94-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-p6c4v\" (UID: \"a5a4b852-9fb0-429f-8873-d2e5da945d94\") " pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:39.912448 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.912414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:46:39.914610 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:39.914590    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0edc73fa-0c68-40aa-81c3-08153894f4e5-metrics-certs\") pod \"network-metrics-daemon-rc6rs\" (UID: \"0edc73fa-0c68-40aa-81c3-08153894f4e5\") " pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:46:40.082485 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.082413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8gxh7\""
Jul 07 18:46:40.085856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.085837    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-htdwq\""
Jul 07 18:46:40.090174 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.090158    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rc6rs"
Jul 07 18:46:40.094390 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.094376    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-p6c4v"
Jul 07 18:46:40.230604 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.230571    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-p6c4v"]
Jul 07 18:46:40.234442 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:40.234419    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5a4b852_9fb0_429f_8873_d2e5da945d94.slice/crio-3fdd804120e784465decc7e28bf9237b893007d9b271522d5a6741e1814338f1 WatchSource:0}: Error finding container 3fdd804120e784465decc7e28bf9237b893007d9b271522d5a6741e1814338f1: Status 404 returned error can't find the container with id 3fdd804120e784465decc7e28bf9237b893007d9b271522d5a6741e1814338f1
Jul 07 18:46:40.244621 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.244599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rc6rs"]
Jul 07 18:46:40.247430 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:40.247395    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0edc73fa_0c68_40aa_81c3_08153894f4e5.slice/crio-808cc3e493b03c602110d4fc5a37e145730587a105c99800a279706faf50ae4f WatchSource:0}: Error finding container 808cc3e493b03c602110d4fc5a37e145730587a105c99800a279706faf50ae4f: Status 404 returned error can't find the container with id 808cc3e493b03c602110d4fc5a37e145730587a105c99800a279706faf50ae4f
Jul 07 18:46:40.570585 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.570542    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6c4v" event={"ID":"a5a4b852-9fb0-429f-8873-d2e5da945d94","Type":"ContainerStarted","Data":"3fdd804120e784465decc7e28bf9237b893007d9b271522d5a6741e1814338f1"}
Jul 07 18:46:40.571638 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:40.571610    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rc6rs" event={"ID":"0edc73fa-0c68-40aa-81c3-08153894f4e5","Type":"ContainerStarted","Data":"808cc3e493b03c602110d4fc5a37e145730587a105c99800a279706faf50ae4f"}
Jul 07 18:46:41.577050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:41.576992    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rc6rs" event={"ID":"0edc73fa-0c68-40aa-81c3-08153894f4e5","Type":"ContainerStarted","Data":"2ca06ef2c59a9aeee51f606e9c5194d38ca147f6cbc7f700830e7b98a34e6e56"}
Jul 07 18:46:42.582967 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:42.582935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rc6rs" event={"ID":"0edc73fa-0c68-40aa-81c3-08153894f4e5","Type":"ContainerStarted","Data":"6f6cccf0c19b879560021d675d62be38fac8968e24d00bf1f227e9f196cf81f1"}
Jul 07 18:46:42.602415 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:42.602215    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rc6rs" podStartSLOduration=131.384951225 podStartE2EDuration="2m12.602195232s" totalImagesPullingTime="1.217244007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:42.600908734 +0000 UTC m=+133.017200708" watchObservedRunningTime="2026-07-07 18:46:42.602195232 +0000 UTC m=+133.018487200"
Jul 07 18:46:44.595052 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:44.595004    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6c4v" event={"ID":"a5a4b852-9fb0-429f-8873-d2e5da945d94","Type":"ContainerStarted","Data":"7e8c63d08d3f2bbef736f9f809d8d8a07c59b29906d08159987e86409ecc17e0"}
Jul 07 18:46:45.353921 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.353892    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:46:45.405359 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.405326    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-574c865c99-gts7t"]
Jul 07 18:46:45.408277 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.408256    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457204 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-bound-sa-token\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457244    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-trusted-ca\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457272    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsl2z\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-kube-api-access-lsl2z\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457404    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-image-registry-private-configuration\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-tls\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457674 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457456    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-ca-trust-extracted\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457674 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457480    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-installation-pull-secrets\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.457674 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.457557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-certificates\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.458513 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.458482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574c865c99-gts7t"]
Jul 07 18:46:45.473553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.473522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:45.557078 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.556994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:45.558960 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.558930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-certificates\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559094 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.558996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-bound-sa-token\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559094 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559048    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-trusted-ca\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559094 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsl2z\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-kube-api-access-lsl2z\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559101    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-image-registry-private-configuration\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559120    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-tls\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559141    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-ca-trust-extracted\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.559264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-installation-pull-secrets\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.560003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.559979    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-ca-trust-extracted\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.560123 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.560080    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-certificates\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.560186 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.560125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-trusted-ca\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.562124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.562101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-image-registry-private-configuration\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.562231 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.562210    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-installation-pull-secrets\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.562376 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.562342    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-registry-tls\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.569378 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.569355    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-bound-sa-token\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.569728 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.569685    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsl2z\" (UniqueName: \"kubernetes.io/projected/b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7-kube-api-access-lsl2z\") pod \"image-registry-574c865c99-gts7t\" (UID: \"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7\") " pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.600102 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.600062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6c4v" event={"ID":"a5a4b852-9fb0-429f-8873-d2e5da945d94","Type":"ContainerStarted","Data":"91e27e20b996d740e1d4547193296894f28a0ed29219c2e6f37f0667bd119d62"}
Jul 07 18:46:45.656353 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.656316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:45.717583 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.717550    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:45.874849 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:45.874820    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-574c865c99-gts7t"]
Jul 07 18:46:45.878078 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:45.878046    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1db3896_ac41_4fa4_8f8f_c0a72fd1d1d7.slice/crio-4005d63f4dcd20bf8d13251a9effddda43ddb698f19d549d00ccd291ced8cbbe WatchSource:0}: Error finding container 4005d63f4dcd20bf8d13251a9effddda43ddb698f19d549d00ccd291ced8cbbe: Status 404 returned error can't find the container with id 4005d63f4dcd20bf8d13251a9effddda43ddb698f19d549d00ccd291ced8cbbe
Jul 07 18:46:46.605749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:46.605702    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574c865c99-gts7t" event={"ID":"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7","Type":"ContainerStarted","Data":"9641957350da095631b8b45082c692c42bc4a0d20fb56559390cab203e11d37c"}
Jul 07 18:46:46.605749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:46.605757    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-574c865c99-gts7t" event={"ID":"b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7","Type":"ContainerStarted","Data":"4005d63f4dcd20bf8d13251a9effddda43ddb698f19d549d00ccd291ced8cbbe"}
Jul 07 18:46:46.606253 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:46.605786    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:46:46.633811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:46.633760    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-574c865c99-gts7t" podStartSLOduration=1.633743719 podStartE2EDuration="1.633743719s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:46.631689775 +0000 UTC m=+137.047981750" watchObservedRunningTime="2026-07-07 18:46:46.633743719 +0000 UTC m=+137.050035691"
Jul 07 18:46:48.173176 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:48.173139    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:48.273425 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:48.273395    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:48.327696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:48.327664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:48.614346 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:48.614261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-p6c4v" event={"ID":"a5a4b852-9fb0-429f-8873-d2e5da945d94","Type":"ContainerStarted","Data":"f12fc2261337e30945b741e98ed863f300a9438234958d1372256d8b0445bdc7"}
Jul 07 18:46:48.634806 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:48.634764    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-p6c4v" podStartSLOduration=34.410861095 podStartE2EDuration="41.634751121s" totalImagesPullingTime="7.223890026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:46:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:48.634247753 +0000 UTC m=+139.050539757" watchObservedRunningTime="2026-07-07 18:46:48.634751121 +0000 UTC m=+139.051043094"
Jul 07 18:46:49.089380 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.089349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:49.140381 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.140350    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"]
Jul 07 18:46:49.143220 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.143205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.147432 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147403    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 07 18:46:49.147565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147440    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 18:46:49.147565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147474    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-27fnl\""
Jul 07 18:46:49.147565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147485    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 18:46:49.147565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147528    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 18:46:49.147565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.147528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 07 18:46:49.155484 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.155464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"]
Jul 07 18:46:49.161131 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.161106    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:49.193117 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.193091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.193423 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.193126    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae47f1-141f-4b51-af58-17bc8aea6b81-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.193423 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.193144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ww4rd\" (UniqueName: \"kubernetes.io/projected/a5ae47f1-141f-4b51-af58-17bc8aea6b81-kube-api-access-ww4rd\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.193423 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.193189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.293487 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.293450    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.293601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.293493    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae47f1-141f-4b51-af58-17bc8aea6b81-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.293601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.293541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ww4rd\" (UniqueName: \"kubernetes.io/projected/a5ae47f1-141f-4b51-af58-17bc8aea6b81-kube-api-access-ww4rd\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.293601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.293570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.293823 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:49.293676    2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found
Jul 07 18:46:49.293823 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:46:49.293766    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls podName:a5ae47f1-141f-4b51-af58-17bc8aea6b81 nodeName:}" failed. No retries permitted until 2026-07-07 18:46:49.793749978 +0000 UTC m=+140.210041929 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls") pod "prometheus-operator-567f7b8b7c-xqv8z" (UID: "a5ae47f1-141f-4b51-af58-17bc8aea6b81") : secret "prometheus-operator-tls" not found
Jul 07 18:46:49.294319 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.294301    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a5ae47f1-141f-4b51-af58-17bc8aea6b81-metrics-client-ca\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.296045 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.296024    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.304052 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.304031    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ww4rd\" (UniqueName: \"kubernetes.io/projected/a5ae47f1-141f-4b51-af58-17bc8aea6b81-kube-api-access-ww4rd\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.409375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.409340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:49.798009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.797906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:49.800209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:49.800191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/a5ae47f1-141f-4b51-af58-17bc8aea6b81-prometheus-operator-tls\") pod \"prometheus-operator-567f7b8b7c-xqv8z\" (UID: \"a5ae47f1-141f-4b51-af58-17bc8aea6b81\") " pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:50.052392 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:50.052295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"
Jul 07 18:46:50.176007 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:50.175984    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z"]
Jul 07 18:46:50.177998 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:50.177972    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5ae47f1_141f_4b51_af58_17bc8aea6b81.slice/crio-bceb18402e95d9243c54f2677da1cc356a1a95d95c1adc72ada02c7f0bdf3554 WatchSource:0}: Error finding container bceb18402e95d9243c54f2677da1cc356a1a95d95c1adc72ada02c7f0bdf3554: Status 404 returned error can't find the container with id bceb18402e95d9243c54f2677da1cc356a1a95d95c1adc72ada02c7f0bdf3554
Jul 07 18:46:50.623833 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:50.623793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z" event={"ID":"a5ae47f1-141f-4b51-af58-17bc8aea6b81","Type":"ContainerStarted","Data":"bceb18402e95d9243c54f2677da1cc356a1a95d95c1adc72ada02c7f0bdf3554"}
Jul 07 18:46:51.520330 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:51.520294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:51.624983 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:51.624954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:51.635022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:51.634987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z" event={"ID":"a5ae47f1-141f-4b51-af58-17bc8aea6b81","Type":"ContainerStarted","Data":"fdfbcdf0c5cfa528882b19fc9e1a1fc6d94820c83472bbaf624111946354a331"}
Jul 07 18:46:51.803225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:51.803128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:52.639327 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:52.639295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z" event={"ID":"a5ae47f1-141f-4b51-af58-17bc8aea6b81","Type":"ContainerStarted","Data":"5520140fdb151f496e04d438c25d2c0dcfa4a8dc7157e184c2a8db3322e59765"}
Jul 07 18:46:52.659056 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:52.659005    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-567f7b8b7c-xqv8z" podStartSLOduration=2.315348868 podStartE2EDuration="3.658986639s" totalImagesPullingTime="1.343637771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:52.658387688 +0000 UTC m=+143.074679659" watchObservedRunningTime="2026-07-07 18:46:52.658986639 +0000 UTC m=+143.075278613"
Jul 07 18:46:54.242991 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.242954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.480025 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.479995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.554778 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.554709    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-cckhw"]
Jul 07 18:46:54.557907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.557892    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.560715 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.560693    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-t5r4f\""
Jul 07 18:46:54.560814 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.560752    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 18:46:54.560875 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.560846    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 18:46:54.561689 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.561671    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 18:46:54.577043 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.577012    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.640937 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.640906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.640942    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-sys\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.640971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-textfile\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.640999    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-accelerators-collector-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.641046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-root\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641213 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.641080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-metrics-client-ca\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641213 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.641122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-tls\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641213 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.641153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-wtmp\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.641213 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.641186    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlchr\" (UniqueName: \"kubernetes.io/projected/24b17875-f0c0-45f9-968a-9fc9f74dfc86-kube-api-access-vlchr\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.668202 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.668169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.742057 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlchr\" (UniqueName: \"kubernetes.io/projected/24b17875-f0c0-45f9-968a-9fc9f74dfc86-kube-api-access-vlchr\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742071    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742103    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-sys\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-textfile\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-accelerators-collector-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742170    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-root\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742229    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-root\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742562 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742476    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-sys\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742562 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-metrics-client-ca\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742574    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-tls\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742659    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-textfile\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742790 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742695    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-wtmp\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742881 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742862    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-wtmp\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.742933 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.742868    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-accelerators-collector-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.743084 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.743062    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24b17875-f0c0-45f9-968a-9fc9f74dfc86-metrics-client-ca\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.744509 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.744484    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.744697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.744682    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/24b17875-f0c0-45f9-968a-9fc9f74dfc86-node-exporter-tls\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.750634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.750608    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlchr\" (UniqueName: \"kubernetes.io/projected/24b17875-f0c0-45f9-968a-9fc9f74dfc86-kube-api-access-vlchr\") pod \"node-exporter-cckhw\" (UID: \"24b17875-f0c0-45f9-968a-9fc9f74dfc86\") " pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.768304 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.768258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.866759 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.866687    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-cckhw"
Jul 07 18:46:54.870108 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.870083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:54.879264 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:54.879240    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b17875_f0c0_45f9_968a_9fc9f74dfc86.slice/crio-fb9a65f7c475c5c1c91665339dc2058ab18040d116be9ed69f2385ea70605176 WatchSource:0}: Error finding container fb9a65f7c475c5c1c91665339dc2058ab18040d116be9ed69f2385ea70605176: Status 404 returned error can't find the container with id fb9a65f7c475c5c1c91665339dc2058ab18040d116be9ed69f2385ea70605176
Jul 07 18:46:54.970393 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:54.970364    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:55.126876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.126782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:55.305246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.305217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:55.359203 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.359166    2578 patch_prober.go:28] interesting pod/image-registry-846d8456d8-9xl86 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 07 18:46:55.359329 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.359217    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:46:55.495298 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.495250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:55.597424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.597388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:55.650155 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.650125    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cckhw" event={"ID":"24b17875-f0c0-45f9-968a-9fc9f74dfc86","Type":"ContainerStarted","Data":"fb9a65f7c475c5c1c91665339dc2058ab18040d116be9ed69f2385ea70605176"}
Jul 07 18:46:55.668540 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:55.668505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:56.655111 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:56.655079    2578 generic.go:356] "Generic (PLEG): container finished" podID="24b17875-f0c0-45f9-968a-9fc9f74dfc86" containerID="5bbb3e7734f40acfe11201dd0c647734fe27f92110ba5bd2c25456e74ed503e8" exitCode=0
Jul 07 18:46:56.655577 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:56.655140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cckhw" event={"ID":"24b17875-f0c0-45f9-968a-9fc9f74dfc86","Type":"ContainerDied","Data":"5bbb3e7734f40acfe11201dd0c647734fe27f92110ba5bd2c25456e74ed503e8"}
Jul 07 18:46:57.480754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.480708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:57.545859 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.545827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:57.660910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.660878    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cckhw" event={"ID":"24b17875-f0c0-45f9-968a-9fc9f74dfc86","Type":"ContainerStarted","Data":"b174b0f3f39a0505ac76f42976bcb033a0971ec558d1111bff338e0b30d05a72"}
Jul 07 18:46:57.661243 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.660955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-cckhw" event={"ID":"24b17875-f0c0-45f9-968a-9fc9f74dfc86","Type":"ContainerStarted","Data":"61befdfb7a7fc1fb21c12944f70e0239d0615af8de3b1b6d871dd43e0e562ef1"}
Jul 07 18:46:57.664824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.664793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:57.697264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.697218    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-cckhw" podStartSLOduration=2.636865167 podStartE2EDuration="3.697203242s" totalImagesPullingTime="998.78805ms" totalInitContainerRuntime="61.550025ms" isStatefulPod=true podCreationTimestamp="2026-07-07 18:46:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:46:57.695400437 +0000 UTC m=+148.111692410" watchObservedRunningTime="2026-07-07 18:46:57.697203242 +0000 UTC m=+148.113495215"
Jul 07 18:46:57.762098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:57.762013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:58.641570 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.641541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:58.742857 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.742821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:58.826184 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.826150    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5bdd745865-f5kll"]
Jul 07 18:46:58.829327 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.829311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.833779 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833690    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-rqzh9\""
Jul 07 18:46:58.833779 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833708    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 07 18:46:58.833779 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833710    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 07 18:46:58.833779 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833748    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 07 18:46:58.834050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833801    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-5cq32kfj9s1n8\""
Jul 07 18:46:58.834050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.833698    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 07 18:46:58.844727 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.844705    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bdd745865-f5kll"]
Jul 07 18:46:58.917320 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.917295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:58.976904 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.976877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977005 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.976910    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-tls\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977005 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.976929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-metrics-server-audit-profiles\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977105 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.977033    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75wf4\" (UniqueName: \"kubernetes.io/projected/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-kube-api-access-75wf4\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977105 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.977068    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-client-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977105 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.977093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:58.977202 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:58.977120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-audit-log\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.077899 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.077867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75wf4\" (UniqueName: \"kubernetes.io/projected/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-kube-api-access-75wf4\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.077904    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-client-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.077930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.077947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-audit-log\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.077993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.078015    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-tls\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078067 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.078031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-metrics-server-audit-profiles\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078393 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.078369    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-audit-log\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.078752 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.078729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.079068 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.079050    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-metrics-server-audit-profiles\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.080434 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.080413    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-client-ca-bundle\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.080973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.080950    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-tls\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.081038 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.080988    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-secret-metrics-server-client-certs\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.087844 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.087824    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75wf4\" (UniqueName: \"kubernetes.io/projected/f329dc1e-b076-46fa-8bcf-050d1c0fa4a4-kube-api-access-75wf4\") pod \"metrics-server-5bdd745865-f5kll\" (UID: \"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4\") " pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.138885 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.138859    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:46:59.270251 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.270188    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5bdd745865-f5kll"]
Jul 07 18:46:59.272237 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:46:59.272209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf329dc1e_b076_46fa_8bcf_050d1c0fa4a4.slice/crio-79eedb1c1374ba1297ac6713e5c1958fa552d267362314a798cd39425ca707c8 WatchSource:0}: Error finding container 79eedb1c1374ba1297ac6713e5c1958fa552d267362314a798cd39425ca707c8: Status 404 returned error can't find the container with id 79eedb1c1374ba1297ac6713e5c1958fa552d267362314a798cd39425ca707c8
Jul 07 18:46:59.273840 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.273813    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:59.331655 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.331614    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:59.668625 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.668591    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll" event={"ID":"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4","Type":"ContainerStarted","Data":"79eedb1c1374ba1297ac6713e5c1958fa552d267362314a798cd39425ca707c8"}
Jul 07 18:46:59.710010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.709977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:59.802587 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.802551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:59.903312 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.903274    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:46:59.957443 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:46:59.957362    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.091698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.091621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.193013 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.192972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.314716 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.314623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.514850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.514811    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.592259 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.592159    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:00.853597 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:00.853566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:01.676950 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:01.676917    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll" event={"ID":"f329dc1e-b076-46fa-8bcf-050d1c0fa4a4","Type":"ContainerStarted","Data":"49db841fa692496915bdf308376051fb90a087b41ce8faf034235176938355fd"}
Jul 07 18:47:01.696214 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:01.696151    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll" podStartSLOduration=2.13723047 podStartE2EDuration="3.696124182s" totalImagesPullingTime="1.558893712s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:46:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:47:01.694916595 +0000 UTC m=+152.111208568" watchObservedRunningTime="2026-07-07 18:47:01.696124182 +0000 UTC m=+152.112416157"
Jul 07 18:47:01.948276 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:01.948180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:02.008345 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:02.008307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:04.772108 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.772077    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:04.777404 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.777387    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.780153 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.780105    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 18:47:04.781286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781271    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 18:47:04.781433 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781422    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 18:47:04.781509 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 18:47:04.781509 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781478    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 18:47:04.781509 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781492    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 18:47:04.781670 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781512    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-kkjdj\""
Jul 07 18:47:04.781670 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.781543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 18:47:04.788659 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.786486    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:04.930063 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgrvd\" (UniqueName: \"kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.930237 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.930237 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930091    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.930237 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930162    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.930362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:04.930362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:04.930287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031212 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031122    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031212 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031212 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgrvd\" (UniqueName: \"kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031485 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031485 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031485 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.031949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.031915    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.032061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.032025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.032121 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.032025    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.033700 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.033670    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.033780 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.033677    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.040850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.040830    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgrvd\" (UniqueName: \"kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd\") pod \"console-74fcf7c79d-qzhfl\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") " pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.090747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.090717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:05.179090 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.179060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:05.219385 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.219244    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:05.221487 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:47:05.221461    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7443254_e6fc_4989_b2a1_1e4cd58451b2.slice/crio-811e49754fd10e438038326b321bbc1b6b4ab13253611acaf82d22fcca1a19a4 WatchSource:0}: Error finding container 811e49754fd10e438038326b321bbc1b6b4ab13253611acaf82d22fcca1a19a4: Status 404 returned error can't find the container with id 811e49754fd10e438038326b321bbc1b6b4ab13253611acaf82d22fcca1a19a4
Jul 07 18:47:05.281341 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.281264    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:05.358722 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.358701    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:47:05.692624 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:05.692589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcf7c79d-qzhfl" event={"ID":"d7443254-e6fc-4989-b2a1-1e4cd58451b2","Type":"ContainerStarted","Data":"811e49754fd10e438038326b321bbc1b6b4ab13253611acaf82d22fcca1a19a4"}
Jul 07 18:47:06.530118 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:06.530080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:06.593721 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:06.593695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:07.136764 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.136725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:07.192678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.192632    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:07.615669 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.615612    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-574c865c99-gts7t"
Jul 07 18:47:07.789771 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.789733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:07.890783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.890672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:07.947572 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:07.947530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:08.705660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:08.705619    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcf7c79d-qzhfl" event={"ID":"d7443254-e6fc-4989-b2a1-1e4cd58451b2","Type":"ContainerStarted","Data":"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"}
Jul 07 18:47:08.731387 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:08.731340    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-74fcf7c79d-qzhfl" podStartSLOduration=1.570686832 podStartE2EDuration="4.731325463s" totalImagesPullingTime="3.160638631s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:47:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:47:08.730117163 +0000 UTC m=+159.146409138" watchObservedRunningTime="2026-07-07 18:47:08.731325463 +0000 UTC m=+159.147617436"
Jul 07 18:47:09.987741 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:47:09.987695    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-n4rjd" podUID="0a072962-d98d-4f73-97f2-ee60f69c2f6a"
Jul 07 18:47:10.373141 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.373052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:10.373375 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.373349    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerName="registry" containerID="cri-o://b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6" gracePeriod=30
Jul 07 18:47:10.440556 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.440523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:10.608058 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.608034    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:47:10.682831 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682800    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682843    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682868    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682902    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682932    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682952    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.682992    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683597 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.683023    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-968kh\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh\") pod \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\" (UID: \"321d1c0f-9a65-4ae7-aa81-9245e6eaf303\") "
Jul 07 18:47:10.683850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.683819    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:10.683945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.683921    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:10.685341 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.685293    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:10.685341 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.685327    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:10.685473 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.685393    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:10.685604 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.685581    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh" (OuterVolumeSpecName: "kube-api-access-968kh") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "kube-api-access-968kh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:10.685725 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.685627    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:10.691397 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.691375    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "321d1c0f-9a65-4ae7-aa81-9245e6eaf303" (UID: "321d1c0f-9a65-4ae7-aa81-9245e6eaf303"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:47:10.713630 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713601    2578 generic.go:356] "Generic (PLEG): container finished" podID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerID="b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6" exitCode=0
Jul 07 18:47:10.713769 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713673    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-846d8456d8-9xl86"
Jul 07 18:47:10.713769 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" event={"ID":"321d1c0f-9a65-4ae7-aa81-9245e6eaf303","Type":"ContainerDied","Data":"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"}
Jul 07 18:47:10.713769 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713740    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-846d8456d8-9xl86" event={"ID":"321d1c0f-9a65-4ae7-aa81-9245e6eaf303","Type":"ContainerDied","Data":"72f38e93f667a88c673c763d0e89a6155be0429c27026692140f399f2af66cd0"}
Jul 07 18:47:10.713887 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713767    2578 scope.go:117] "RemoveContainer" containerID="b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"
Jul 07 18:47:10.713938 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.713903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:10.722277 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.722260    2578 scope.go:117] "RemoveContainer" containerID="b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"
Jul 07 18:47:10.722528 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:47:10.722509    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6\": container with ID starting with b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6 not found: ID does not exist" containerID="b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"
Jul 07 18:47:10.722587 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.722538    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6"} err="failed to get container status \"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6\": rpc error: code = NotFound desc = could not find container \"b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6\": container with ID starting with b9c9f25de6334544db73d624fa93b1cf22947f0f485b6f389bea9ad1769e11e6 not found: ID does not exist"
Jul 07 18:47:10.741380 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.741357    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:47:10.746504 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.746475    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-846d8456d8-9xl86"]
Jul 07 18:47:10.783788 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783764    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-image-registry-private-configuration\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783788 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783784    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-bound-sa-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783800    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-trusted-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783813    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-968kh\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-kube-api-access-968kh\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783824    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783837    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-registry-certificates\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783848    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-ca-trust-extracted\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:10.783949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:10.783860    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/321d1c0f-9a65-4ae7-aa81-9245e6eaf303-installation-pull-secrets\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:12.069201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.069172    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" path="/var/lib/kubelet/pods/321d1c0f-9a65-4ae7-aa81-9245e6eaf303/volumes"
Jul 07 18:47:12.142069 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.142041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:12.948107 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.948073    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:47:12.948353 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.948338    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerName="registry"
Jul 07 18:47:12.948404 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.948357    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerName="registry"
Jul 07 18:47:12.948436 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.948405    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="321d1c0f-9a65-4ae7-aa81-9245e6eaf303" containerName="registry"
Jul 07 18:47:12.953329 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.953312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:12.962284 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.962266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 18:47:12.967436 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:12.967416    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:47:13.003769 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.003909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003781    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fns2p\" (UniqueName: \"kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.003909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.003909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.003909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003868    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.003909 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.004068 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.003963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104511 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104533    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fns2p\" (UniqueName: \"kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104590    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104622    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.104973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.104746    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.105318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.105294    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.105595 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.105573    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.105714 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.105691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.105785 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.105758    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.107169 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.107148    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.107248 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.107232    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.115252 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.115228    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fns2p\" (UniqueName: \"kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p\") pod \"console-5d864489cc-gzdqc\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") " pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.262227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.262123    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:13.392362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.392331    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:47:13.395890 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:47:13.395865    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a886235_2b35_49ba_9016_d7a919bbb8c0.slice/crio-a9359ec6f7e8ef910d4dc253cf5753a395518c023835ff7f9879e8a0403a0d97 WatchSource:0}: Error finding container a9359ec6f7e8ef910d4dc253cf5753a395518c023835ff7f9879e8a0403a0d97: Status 404 returned error can't find the container with id a9359ec6f7e8ef910d4dc253cf5753a395518c023835ff7f9879e8a0403a0d97
Jul 07 18:47:13.725744 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.725706    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864489cc-gzdqc" event={"ID":"2a886235-2b35-49ba-9016-d7a919bbb8c0","Type":"ContainerStarted","Data":"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"}
Jul 07 18:47:13.725907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.725791    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864489cc-gzdqc" event={"ID":"2a886235-2b35-49ba-9016-d7a919bbb8c0","Type":"ContainerStarted","Data":"a9359ec6f7e8ef910d4dc253cf5753a395518c023835ff7f9879e8a0403a0d97"}
Jul 07 18:47:13.747514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:13.747467    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5d864489cc-gzdqc" podStartSLOduration=1.7474525010000002 podStartE2EDuration="1.747452501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:47:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:47:13.745842252 +0000 UTC m=+164.162134226" watchObservedRunningTime="2026-07-07 18:47:13.747452501 +0000 UTC m=+164.163744473"
Jul 07 18:47:14.745701 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:14.745665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:14.848133 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:14.848102    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:14.913028 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:14.912999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:14.918820 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:14.918788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:14.921021 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:14.920993    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0a072962-d98d-4f73-97f2-ee60f69c2f6a-metrics-tls\") pod \"dns-default-n4rjd\" (UID: \"0a072962-d98d-4f73-97f2-ee60f69c2f6a\") " pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:15.091319 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.091236    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:15.091506 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.091485    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:15.096316 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.096295    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:15.217943 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.217910    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-pgd5v\""
Jul 07 18:47:15.225599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.225577    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:15.353915 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.353890    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-n4rjd"]
Jul 07 18:47:15.356425 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:47:15.356396    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a072962_d98d_4f73_97f2_ee60f69c2f6a.slice/crio-40143dc862c0db351b6f22b84293b0268e36aff792227485d348f0824f6879a5 WatchSource:0}: Error finding container 40143dc862c0db351b6f22b84293b0268e36aff792227485d348f0824f6879a5: Status 404 returned error can't find the container with id 40143dc862c0db351b6f22b84293b0268e36aff792227485d348f0824f6879a5
Jul 07 18:47:15.733535 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.733502    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4rjd" event={"ID":"0a072962-d98d-4f73-97f2-ee60f69c2f6a","Type":"ContainerStarted","Data":"40143dc862c0db351b6f22b84293b0268e36aff792227485d348f0824f6879a5"}
Jul 07 18:47:15.737916 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:15.737888    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:16.218424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:16.218382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:16.279578 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:16.279545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:17.742351 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:17.742317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4rjd" event={"ID":"0a072962-d98d-4f73-97f2-ee60f69c2f6a","Type":"ContainerStarted","Data":"6f143511b68f0c918344986b2dbec4da7f5e9501cec7986adf1379de08ad7b21"}
Jul 07 18:47:18.747849 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:18.747808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-n4rjd" event={"ID":"0a072962-d98d-4f73-97f2-ee60f69c2f6a","Type":"ContainerStarted","Data":"de1a9fd5d049ad7aad60c27e21544ca75b488bfbdb9c37935588e8ee77970d83"}
Jul 07 18:47:18.748228 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:18.747910    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:18.771424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:18.771376    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-n4rjd" podStartSLOduration=130.670054506 podStartE2EDuration="2m12.771361832s" totalImagesPullingTime="2.101307326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:45:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:47:18.7697598 +0000 UTC m=+169.186051774" watchObservedRunningTime="2026-07-07 18:47:18.771361832 +0000 UTC m=+169.187653805"
Jul 07 18:47:19.140020 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:19.139937    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:47:19.140020 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:19.139995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:47:19.362456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:19.362419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:19.468140 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:19.468100    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:20.360085 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:20.360048    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:20.462547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:20.462513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:23.262780 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.262696    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:23.263963 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.263854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:23.269220 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.269197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:23.769726 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.769700    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:47:23.820074 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.820039    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:23.938134 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:23.938099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:24.038300 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:24.038215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:24.139234 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:24.139201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:25.381746 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:25.381710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:25.473156 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:25.473119    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:28.753840 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:28.753807    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-n4rjd"
Jul 07 18:47:28.943598 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:28.943555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:29.045000 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:29.044910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:29.105632 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:29.105602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:36.517979 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:36.517943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:36.578054 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:36.578025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:37.817283 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:37.817203    2578 generic.go:356] "Generic (PLEG): container finished" podID="4b9d926f-f9e6-4a08-88cd-4117d8e59f25" containerID="7cd9195c1a19fe2e62b906d608c06591fc0a3232e9373822269b49af06817133" exitCode=0
Jul 07 18:47:37.817283 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:37.817259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z" event={"ID":"4b9d926f-f9e6-4a08-88cd-4117d8e59f25","Type":"ContainerDied","Data":"7cd9195c1a19fe2e62b906d608c06591fc0a3232e9373822269b49af06817133"}
Jul 07 18:47:37.817681 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:37.817555    2578 scope.go:117] "RemoveContainer" containerID="7cd9195c1a19fe2e62b906d608c06591fc0a3232e9373822269b49af06817133"
Jul 07 18:47:37.907525 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:37.907494    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:37.959025 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:37.958995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:38.822825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:38.822788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-prf9z" event={"ID":"4b9d926f-f9e6-4a08-88cd-4117d8e59f25","Type":"ContainerStarted","Data":"49b3b814a7c1fee6a8ad311120dca7470e08650b4dd622b5ba8bad4d5c398339"}
Jul 07 18:47:39.144702 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:39.144617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:47:39.148408 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:39.148388    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5bdd745865-f5kll"
Jul 07 18:47:48.839893 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:48.839856    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-74fcf7c79d-qzhfl" podUID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" containerName="console" containerID="cri-o://8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add" gracePeriod=15
Jul 07 18:47:49.088356 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.088331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:49.224829 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.224799    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225034 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.224841    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgrvd\" (UniqueName: \"kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225034 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.224908    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225034 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.224932    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225185 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225079    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225185 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225144    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config\") pod \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\" (UID: \"d7443254-e6fc-4989-b2a1-1e4cd58451b2\") "
Jul 07 18:47:49.225321 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225286    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:49.225426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225395    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-oauth-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.225426 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225387    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:49.225698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.225677    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config" (OuterVolumeSpecName: "console-config") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:47:49.227421 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.227368    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:49.227421 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.227385    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:47:49.227592 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.227487    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd" (OuterVolumeSpecName: "kube-api-access-wgrvd") pod "d7443254-e6fc-4989-b2a1-1e4cd58451b2" (UID: "d7443254-e6fc-4989-b2a1-1e4cd58451b2"). InnerVolumeSpecName "kube-api-access-wgrvd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:47:49.325787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.325754    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-oauth-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.325787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.325779    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.325787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.325789    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgrvd\" (UniqueName: \"kubernetes.io/projected/d7443254-e6fc-4989-b2a1-1e4cd58451b2-kube-api-access-wgrvd\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.325787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.325798    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7443254-e6fc-4989-b2a1-1e4cd58451b2-console-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.326118 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.325807    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7443254-e6fc-4989-b2a1-1e4cd58451b2-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:47:49.864108 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.864072    2578 generic.go:356] "Generic (PLEG): container finished" podID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" containerID="8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add" exitCode=0
Jul 07 18:47:49.864553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.864136    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-74fcf7c79d-qzhfl"
Jul 07 18:47:49.864553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.864147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcf7c79d-qzhfl" event={"ID":"d7443254-e6fc-4989-b2a1-1e4cd58451b2","Type":"ContainerDied","Data":"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"}
Jul 07 18:47:49.864553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.864222    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-74fcf7c79d-qzhfl" event={"ID":"d7443254-e6fc-4989-b2a1-1e4cd58451b2","Type":"ContainerDied","Data":"811e49754fd10e438038326b321bbc1b6b4ab13253611acaf82d22fcca1a19a4"}
Jul 07 18:47:49.864553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.864244    2578 scope.go:117] "RemoveContainer" containerID="8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"
Jul 07 18:47:49.873150 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.873131    2578 scope.go:117] "RemoveContainer" containerID="8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"
Jul 07 18:47:49.873439 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:47:49.873418    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add\": container with ID starting with 8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add not found: ID does not exist" containerID="8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"
Jul 07 18:47:49.873501 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.873452    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add"} err="failed to get container status \"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add\": rpc error: code = NotFound desc = could not find container \"8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add\": container with ID starting with 8aaed256b157fc770ee7c64e9c84bfb628cfc61a1285c2a4f7215411f9740add not found: ID does not exist"
Jul 07 18:47:49.891856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.891824    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:49.900222 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:49.900191    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-74fcf7c79d-qzhfl"]
Jul 07 18:47:50.069404 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:50.069372    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" path="/var/lib/kubelet/pods/d7443254-e6fc-4989-b2a1-1e4cd58451b2/volumes"
Jul 07 18:47:51.518199 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:51.518165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:47:51.581586 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:47:51.581552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:10.692715 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:10.692676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:10.754762 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:10.754725    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:15.123511 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.123479    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:48:15.123900 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.123789    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" containerName="console"
Jul 07 18:48:15.123900 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.123801    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" containerName="console"
Jul 07 18:48:15.123900 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.123846    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7443254-e6fc-4989-b2a1-1e4cd58451b2" containerName="console"
Jul 07 18:48:15.126176 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.126161    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.138404 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.138379    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:48:15.187487 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.187450    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:15.220636 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220603    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220636 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220638    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220674    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220734    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vc66k\" (UniqueName: \"kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220764    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.220845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.220797    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.321919 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.321879    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.321919 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.321923    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.321946    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.321972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vc66k\" (UniqueName: \"kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322061 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.322894 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322865    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.323018 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322918    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.323018 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322927    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.323018 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.322970    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.324536 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.324509    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.324536 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.324534    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.332386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.332364    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vc66k\" (UniqueName: \"kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k\") pod \"console-655b6ff544-sc8lc\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") " pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.436086 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.436054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:15.565124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.565100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:48:15.567562 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:48:15.567539    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89ee4df3_3ab6_4e04_ae57_8d03d8775e14.slice/crio-08f545b0a766402159f3a038b16f9066cb5c734a9c5c48fb9e309a86709f674d WatchSource:0}: Error finding container 08f545b0a766402159f3a038b16f9066cb5c734a9c5c48fb9e309a86709f674d: Status 404 returned error can't find the container with id 08f545b0a766402159f3a038b16f9066cb5c734a9c5c48fb9e309a86709f674d
Jul 07 18:48:15.956198 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.956161    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6ff544-sc8lc" event={"ID":"89ee4df3-3ab6-4e04-ae57-8d03d8775e14","Type":"ContainerStarted","Data":"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"}
Jul 07 18:48:15.956458 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.956210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6ff544-sc8lc" event={"ID":"89ee4df3-3ab6-4e04-ae57-8d03d8775e14","Type":"ContainerStarted","Data":"08f545b0a766402159f3a038b16f9066cb5c734a9c5c48fb9e309a86709f674d"}
Jul 07 18:48:15.980416 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:15.980362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-655b6ff544-sc8lc" podStartSLOduration=0.980344632 podStartE2EDuration="980.344632ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:48:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:48:15.97833496 +0000 UTC m=+226.394626935" watchObservedRunningTime="2026-07-07 18:48:15.980344632 +0000 UTC m=+226.396636604"
Jul 07 18:48:16.625926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.624357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 18:48:16.628431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.628412    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.631415 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 18:48:16.631415 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631389    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 18:48:16.631713 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 18:48:16.631713 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 18:48:16.631869 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 18:48:16.631953 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.631876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 18:48:16.632031 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.632009    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-q2lp2\""
Jul 07 18:48:16.632031 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.632023    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 18:48:16.632936 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.632913    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 18:48:16.637114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.637092    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 18:48:16.641464 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.641446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 18:48:16.733362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733364    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsdpp\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-kube-api-access-wsdpp\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733469    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-web-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733499    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733516    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-out\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733557    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733735    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.733827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.733806    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834522 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834526    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-out\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834777 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834548    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834777 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834565    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834777 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834777 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834860    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.834969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.835209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.834979    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.835209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.835001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsdpp\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-kube-api-access-wsdpp\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.835209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.835050    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-web-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.835591 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.835561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.836182 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.836156    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.837540 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.837510    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-out\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.837937 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.837892    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.837955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.837981    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-web-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.838007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838492 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.838466    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-config-volume\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838599 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.838507    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.838748 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.838729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.839742 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.839722    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.846038 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.846017    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsdpp\" (UniqueName: \"kubernetes.io/projected/8ee2ad3a-a5eb-42c3-af5c-ca145df846b1-kube-api-access-wsdpp\") pod \"alertmanager-main-0\" (UID: \"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:16.938247 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:16.938203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 18:48:17.076687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:17.076657    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 18:48:17.079262 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:48:17.079238    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ee2ad3a_a5eb_42c3_af5c_ca145df846b1.slice/crio-fca95f918e5740d6f4c5e55c820a609c20f8593d218ea06f2acffa23d7dd2fab WatchSource:0}: Error finding container fca95f918e5740d6f4c5e55c820a609c20f8593d218ea06f2acffa23d7dd2fab: Status 404 returned error can't find the container with id fca95f918e5740d6f4c5e55c820a609c20f8593d218ea06f2acffa23d7dd2fab
Jul 07 18:48:17.966157 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:17.966122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"fca95f918e5740d6f4c5e55c820a609c20f8593d218ea06f2acffa23d7dd2fab"}
Jul 07 18:48:18.971708 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:18.971670    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ee2ad3a-a5eb-42c3-af5c-ca145df846b1" containerID="4abc193e5f6ff9bb52e85da42355620a7b65e178cbed080f0a7dabff6064619c" exitCode=0
Jul 07 18:48:18.972174 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:18.971758    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerDied","Data":"4abc193e5f6ff9bb52e85da42355620a7b65e178cbed080f0a7dabff6064619c"}
Jul 07 18:48:20.982782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:20.982749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"64b93694450048fd2fcbaf8efbf53e902b0497b458efadc91d3f49347eaf8990"}
Jul 07 18:48:20.983148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:20.982812    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"c009cda26cf93af9df9eb6371a5363a99a54e042d694f14cb8fbaf7a8a5a6aa9"}
Jul 07 18:48:20.983148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:20.982836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"d37d8974bb43bbefbe8e7e62bd66e28c8964b9fc7755acc428d006195d30167a"}
Jul 07 18:48:20.983148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:20.982861    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"b6b418fa1581979f2e25b9d7c8195428a567e2349e835a03db5a858cb47569c3"}
Jul 07 18:48:20.983148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:20.982884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"f9dd234c3c90db55dea417f94784b1a13408085aae041fec62e201f1226f6590"}
Jul 07 18:48:21.989747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:21.989664    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8ee2ad3a-a5eb-42c3-af5c-ca145df846b1","Type":"ContainerStarted","Data":"3afa503763b462f5cf53d3a84dd18ded709f9233066cdd3d66d9fa4bbaf761a2"}
Jul 07 18:48:22.022829 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:22.022773    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.125673156 podStartE2EDuration="6.022751436s" totalImagesPullingTime="3.882399624s" totalInitContainerRuntime="14.678656ms" isStatefulPod=false podCreationTimestamp="2026-07-07 18:48:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:48:22.021139756 +0000 UTC m=+232.437431731" watchObservedRunningTime="2026-07-07 18:48:22.022751436 +0000 UTC m=+232.439043410"
Jul 07 18:48:22.645453 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:22.645418    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:22.702071 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:22.702039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:24.084044 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:24.084006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:24.144444 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:24.144412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:24.719467 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:24.719435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:25.436861 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:25.436807    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:25.437246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:25.436892    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:25.441709 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:25.441685    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:26.010086 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:26.010053    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:48:26.074715 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:26.074686    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:48:26.289995 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:26.289904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:26.387495 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:26.387458    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:29.195830 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:29.195783    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:29.296441 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:29.296400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:29.355085 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:29.355056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:50.834312 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:50.834269    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:50.934771 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:50.934735    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:48:51.094097 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.094022    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5d864489cc-gzdqc" podUID="2a886235-2b35-49ba-9016-d7a919bbb8c0" containerName="console" containerID="cri-o://af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef" gracePeriod=15
Jul 07 18:48:51.341829 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.341799    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:48:51.415821 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.415787    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"]
Jul 07 18:48:51.416150 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.416133    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a886235-2b35-49ba-9016-d7a919bbb8c0" containerName="console"
Jul 07 18:48:51.416230 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.416153    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a886235-2b35-49ba-9016-d7a919bbb8c0" containerName="console"
Jul 07 18:48:51.416230 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.416216    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a886235-2b35-49ba-9016-d7a919bbb8c0" containerName="console"
Jul 07 18:48:51.419175 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.419155    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.426837 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.422421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:48:51.426837 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.422489    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:48:51.426837 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.422895    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dhxqn\""
Jul 07 18:48:51.429545 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429521    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fns2p\" (UniqueName: \"kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429559    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429595    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429667    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429962 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config\") pod \"2a886235-2b35-49ba-9016-d7a919bbb8c0\" (UID: \"2a886235-2b35-49ba-9016-d7a919bbb8c0\") "
Jul 07 18:48:51.429962 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429941    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rszp\" (UniqueName: \"kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.430377 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.429984    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.430377 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.430007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.430377 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.430023    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config" (OuterVolumeSpecName: "console-config") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:48:51.430377 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.430050    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:48:51.430607 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.430483    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca" (OuterVolumeSpecName: "service-ca") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:48:51.430880 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.430841    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:48:51.432612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.432455    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p" (OuterVolumeSpecName: "kube-api-access-fns2p") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "kube-api-access-fns2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:48:51.432612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.432525    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:48:51.432612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.432569    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2a886235-2b35-49ba-9016-d7a919bbb8c0" (UID: "2a886235-2b35-49ba-9016-d7a919bbb8c0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:48:51.433804 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.433780    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"]
Jul 07 18:48:51.531225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531180    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.531225 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rszp\" (UniqueName: \"kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531326    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-oauth-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531336    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fns2p\" (UniqueName: \"kubernetes.io/projected/2a886235-2b35-49ba-9016-d7a919bbb8c0-kube-api-access-fns2p\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531346    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531357    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-trusted-ca-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531369    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531382    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2a886235-2b35-49ba-9016-d7a919bbb8c0-oauth-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531394    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2a886235-2b35-49ba-9016-d7a919bbb8c0-console-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:48:51.531824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531625    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.531824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.531621    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.541571 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.541535    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rszp\" (UniqueName: \"kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.733527 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.733430    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:48:51.866101 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:51.866066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"]
Jul 07 18:48:51.869268 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:48:51.869246    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod948a21fc_1fcb_4f84_9cc3_e1b9d7261508.slice/crio-3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387 WatchSource:0}: Error finding container 3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387: Status 404 returned error can't find the container with id 3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387
Jul 07 18:48:52.103173 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.103142    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerStarted","Data":"3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387"}
Jul 07 18:48:52.104437 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.104408    2578 generic.go:356] "Generic (PLEG): container finished" podID="2a886235-2b35-49ba-9016-d7a919bbb8c0" containerID="af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef" exitCode=0
Jul 07 18:48:52.104547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.104460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864489cc-gzdqc" event={"ID":"2a886235-2b35-49ba-9016-d7a919bbb8c0","Type":"ContainerDied","Data":"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"}
Jul 07 18:48:52.104547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.104492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5d864489cc-gzdqc" event={"ID":"2a886235-2b35-49ba-9016-d7a919bbb8c0","Type":"ContainerDied","Data":"a9359ec6f7e8ef910d4dc253cf5753a395518c023835ff7f9879e8a0403a0d97"}
Jul 07 18:48:52.104547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.104511    2578 scope.go:117] "RemoveContainer" containerID="af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"
Jul 07 18:48:52.104547 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.104463    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5d864489cc-gzdqc"
Jul 07 18:48:52.117070 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.117054    2578 scope.go:117] "RemoveContainer" containerID="af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"
Jul 07 18:48:52.117310 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:48:52.117290    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef\": container with ID starting with af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef not found: ID does not exist" containerID="af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"
Jul 07 18:48:52.117353 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.117319    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef"} err="failed to get container status \"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef\": rpc error: code = NotFound desc = could not find container \"af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef\": container with ID starting with af607019ddacfce9e16205d67f5b039adb848bb07df458727240455b3788fcef not found: ID does not exist"
Jul 07 18:48:52.131785 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.131763    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:48:52.139057 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:52.139037    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5d864489cc-gzdqc"]
Jul 07 18:48:54.070170 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:48:54.070127    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a886235-2b35-49ba-9016-d7a919bbb8c0" path="/var/lib/kubelet/pods/2a886235-2b35-49ba-9016-d7a919bbb8c0/volumes"
Jul 07 18:49:00.138436 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:00.138403    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerStarted","Data":"d818add3b89445dec8b07a37a1f022fd16f08e3d0caa2dc962c87ace4c378a5f"}
Jul 07 18:49:01.142864 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:01.142825    2578 generic.go:356] "Generic (PLEG): container finished" podID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerID="d818add3b89445dec8b07a37a1f022fd16f08e3d0caa2dc962c87ace4c378a5f" exitCode=0
Jul 07 18:49:01.143430 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:01.142906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerDied","Data":"d818add3b89445dec8b07a37a1f022fd16f08e3d0caa2dc962c87ace4c378a5f"}
Jul 07 18:49:03.152623 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:03.152594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerStarted","Data":"162a11a85ef63b3afed185937f3ad4fb18e84244781c375eb9f9048065834443"}
Jul 07 18:49:04.157763 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:04.157731    2578 generic.go:356] "Generic (PLEG): container finished" podID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerID="162a11a85ef63b3afed185937f3ad4fb18e84244781c375eb9f9048065834443" exitCode=0
Jul 07 18:49:04.158123 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:04.157819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerDied","Data":"162a11a85ef63b3afed185937f3ad4fb18e84244781c375eb9f9048065834443"}
Jul 07 18:49:08.730251 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:08.730215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:12.194913 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:12.194821    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerStarted","Data":"94e8f86be70e35d7aa1bfe1265544a93d3c70e45bb8582b425ffc4b9476584ef"}
Jul 07 18:49:12.217022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:12.216974    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" podStartSLOduration=3.197437687 podStartE2EDuration="21.216959081s" totalImagesPullingTime="18.019521394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:48:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:12.215812636 +0000 UTC m=+282.632104611" watchObservedRunningTime="2026-07-07 18:49:12.216959081 +0000 UTC m=+282.633251053"
Jul 07 18:49:13.202518 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:13.202483    2578 generic.go:356] "Generic (PLEG): container finished" podID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerID="94e8f86be70e35d7aa1bfe1265544a93d3c70e45bb8582b425ffc4b9476584ef" exitCode=0
Jul 07 18:49:13.202895 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:13.202573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerDied","Data":"94e8f86be70e35d7aa1bfe1265544a93d3c70e45bb8582b425ffc4b9476584ef"}
Jul 07 18:49:13.407217 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:13.407182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:13.464172 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:13.464099    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:14.376425 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.376397    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:49:14.522629 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.522554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util\") pod \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") "
Jul 07 18:49:14.522629 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.522608    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle\") pod \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") "
Jul 07 18:49:14.522879 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.522660    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rszp\" (UniqueName: \"kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp\") pod \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\" (UID: \"948a21fc-1fcb-4f84-9cc3-e1b9d7261508\") "
Jul 07 18:49:14.523283 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.523256    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle" (OuterVolumeSpecName: "bundle") pod "948a21fc-1fcb-4f84-9cc3-e1b9d7261508" (UID: "948a21fc-1fcb-4f84-9cc3-e1b9d7261508"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:14.524810 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.524780    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp" (OuterVolumeSpecName: "kube-api-access-6rszp") pod "948a21fc-1fcb-4f84-9cc3-e1b9d7261508" (UID: "948a21fc-1fcb-4f84-9cc3-e1b9d7261508"). InnerVolumeSpecName "kube-api-access-6rszp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:49:14.527186 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.527163    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util" (OuterVolumeSpecName: "util") pod "948a21fc-1fcb-4f84-9cc3-e1b9d7261508" (UID: "948a21fc-1fcb-4f84-9cc3-e1b9d7261508"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:14.623684 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.623627    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rszp\" (UniqueName: \"kubernetes.io/projected/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-kube-api-access-6rszp\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:14.623884 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.623869    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:14.623968 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:14.623958    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/948a21fc-1fcb-4f84-9cc3-e1b9d7261508-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:15.211318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:15.211283    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg" event={"ID":"948a21fc-1fcb-4f84-9cc3-e1b9d7261508","Type":"ContainerDied","Data":"3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387"}
Jul 07 18:49:15.211318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:15.211311    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675406sgcg"
Jul 07 18:49:15.211519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:15.211339    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3272a6864d9975d9951f99c5a0e758dbc220ed499cec5dcc13eb7e880fd13387"
Jul 07 18:49:17.439526 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:17.439479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:18.443840 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:18.443804    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:19.411721 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411695    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"]
Jul 07 18:49:19.411965 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411953    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="pull"
Jul 07 18:49:19.412010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411966    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="pull"
Jul 07 18:49:19.412010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411983    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="extract"
Jul 07 18:49:19.412010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411990    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="extract"
Jul 07 18:49:19.412010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.411999    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="util"
Jul 07 18:49:19.412010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.412004    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="util"
Jul 07 18:49:19.412156 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.412070    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="948a21fc-1fcb-4f84-9cc3-e1b9d7261508" containerName="extract"
Jul 07 18:49:19.413990 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.413975    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.418867 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.418833    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 18:49:19.419009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.418968    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 18:49:19.419009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.419003    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-5r5j7\""
Jul 07 18:49:19.449437 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.449406    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"]
Jul 07 18:49:19.569124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.569080    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvcj8\" (UniqueName: \"kubernetes.io/projected/b7ff9dab-9415-435c-81b3-ce9a3867f311-kube-api-access-rvcj8\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.569124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.569122    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ff9dab-9415-435c-81b3-ce9a3867f311-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.670373 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.670291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvcj8\" (UniqueName: \"kubernetes.io/projected/b7ff9dab-9415-435c-81b3-ce9a3867f311-kube-api-access-rvcj8\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.670373 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.670345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ff9dab-9415-435c-81b3-ce9a3867f311-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.670794 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.670772    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b7ff9dab-9415-435c-81b3-ce9a3867f311-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.680810 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.680779    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvcj8\" (UniqueName: \"kubernetes.io/projected/b7ff9dab-9415-435c-81b3-ce9a3867f311-kube-api-access-rvcj8\") pod \"cert-manager-operator-controller-manager-55c444bf86-jmk8k\" (UID: \"b7ff9dab-9415-435c-81b3-ce9a3867f311\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.722781 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.722745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"
Jul 07 18:49:19.861475 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:19.861437    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k"]
Jul 07 18:49:19.865694 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:19.865666    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7ff9dab_9415_435c_81b3_ce9a3867f311.slice/crio-0573a5ae5794ec94d4977047e16719b1d985f4abfdd329b8ada9c3bf8fa45f35 WatchSource:0}: Error finding container 0573a5ae5794ec94d4977047e16719b1d985f4abfdd329b8ada9c3bf8fa45f35: Status 404 returned error can't find the container with id 0573a5ae5794ec94d4977047e16719b1d985f4abfdd329b8ada9c3bf8fa45f35
Jul 07 18:49:20.230401 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:20.230371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k" event={"ID":"b7ff9dab-9415-435c-81b3-ce9a3867f311","Type":"ContainerStarted","Data":"0573a5ae5794ec94d4977047e16719b1d985f4abfdd329b8ada9c3bf8fa45f35"}
Jul 07 18:49:21.052938 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:21.052883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:21.110393 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:21.110347    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:22.240611 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:22.240574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k" event={"ID":"b7ff9dab-9415-435c-81b3-ce9a3867f311","Type":"ContainerStarted","Data":"d30457af55a3f564d0272c1348e89ec16bebf2c05b2d63231b4cc1f360d95fe5"}
Jul 07 18:49:22.267085 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:22.267031    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-jmk8k" podStartSLOduration=1.796601501 podStartE2EDuration="3.267015806s" totalImagesPullingTime="1.470414305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:22.264319189 +0000 UTC m=+292.680611162" watchObservedRunningTime="2026-07-07 18:49:22.267015806 +0000 UTC m=+292.683307779"
Jul 07 18:49:22.725308 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:22.725273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:22.820976 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:22.820938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:22.929754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:22.929720    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:23.023345 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.023267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:23.404531 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.404501    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"]
Jul 07 18:49:23.407022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.407006    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.409945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.409923    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:49:23.409945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.409938    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:49:23.411081 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.411065    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dhxqn\""
Jul 07 18:49:23.419253 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.419228    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"]
Jul 07 18:49:23.501434 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.501397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6ktp\" (UniqueName: \"kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.501600 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.501457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.501600 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.501495    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.602755 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.602716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6ktp\" (UniqueName: \"kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.602935 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.602771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.602935 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.602799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.603158 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.603139    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.603236 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.603203    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.614877 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.614853    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6ktp\" (UniqueName: \"kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.716316 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.716224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:23.845221 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:23.845194    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"]
Jul 07 18:49:23.850053 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:23.850023    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6be0fbdc_627a_44f1_a649_4cd083b892a8.slice/crio-c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a WatchSource:0}: Error finding container c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a: Status 404 returned error can't find the container with id c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a
Jul 07 18:49:24.255513 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:24.255478    2578 generic.go:356] "Generic (PLEG): container finished" podID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerID="596060742ee6d4979dfd02a6215928fc16c6791a48b095aef0f38c4c48129154" exitCode=0
Jul 07 18:49:24.255700 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:24.255517    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms" event={"ID":"6be0fbdc-627a-44f1-a649-4cd083b892a8","Type":"ContainerDied","Data":"596060742ee6d4979dfd02a6215928fc16c6791a48b095aef0f38c4c48129154"}
Jul 07 18:49:24.255700 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:24.255586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms" event={"ID":"6be0fbdc-627a-44f1-a649-4cd083b892a8","Type":"ContainerStarted","Data":"c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a"}
Jul 07 18:49:24.712852 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:24.712814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:25.311982 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:25.311933    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:25.724562 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:25.724511    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:27.271995 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:27.271959    2578 generic.go:356] "Generic (PLEG): container finished" podID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerID="55039eb93b4e884e6786810a8d8f039e9a804d269b5c313d629d7fa64cfa3bbd" exitCode=0
Jul 07 18:49:27.272358 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:27.272038    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms" event={"ID":"6be0fbdc-627a-44f1-a649-4cd083b892a8","Type":"ContainerDied","Data":"55039eb93b4e884e6786810a8d8f039e9a804d269b5c313d629d7fa64cfa3bbd"}
Jul 07 18:49:28.056952 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.056920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:28.080854 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.080822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"]
Jul 07 18:49:28.083198 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.083179    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.086235 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.086216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-2dvsf\""
Jul 07 18:49:28.086319 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.086243    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 18:49:28.086319 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.086262    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 18:49:28.095765 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.095742    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"]
Jul 07 18:49:28.155720 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.155623    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:28.244527 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.244494    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.244710 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.244636    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7kmm\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-kube-api-access-m7kmm\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.278103 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.278073    2578 generic.go:356] "Generic (PLEG): container finished" podID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerID="015388f6d679644a17d07a5a1ba1b64ad9dc83c496718191f5b81be29c21a75e" exitCode=0
Jul 07 18:49:28.278499 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.278168    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms" event={"ID":"6be0fbdc-627a-44f1-a649-4cd083b892a8","Type":"ContainerDied","Data":"015388f6d679644a17d07a5a1ba1b64ad9dc83c496718191f5b81be29c21a75e"}
Jul 07 18:49:28.345749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.345659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7kmm\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-kube-api-access-m7kmm\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.345749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.345731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.358724 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.358699    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.358865 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.358757    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7kmm\" (UniqueName: \"kubernetes.io/projected/8bdcf1dc-e9db-4029-a4a8-cc1525a96da4-kube-api-access-m7kmm\") pod \"cert-manager-cainjector-559cdd8c87-dc7nr\" (UID: \"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.415160 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.415127    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"
Jul 07 18:49:28.551088 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:28.551058    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr"]
Jul 07 18:49:28.554611 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:28.554582    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8bdcf1dc_e9db_4029_a4a8_cc1525a96da4.slice/crio-cdf2ff77c1275222fc6834169eed24a3bb49258161ae850a6aba5de97aee4a20 WatchSource:0}: Error finding container cdf2ff77c1275222fc6834169eed24a3bb49258161ae850a6aba5de97aee4a20: Status 404 returned error can't find the container with id cdf2ff77c1275222fc6834169eed24a3bb49258161ae850a6aba5de97aee4a20
Jul 07 18:49:29.283653 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.283603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr" event={"ID":"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4","Type":"ContainerStarted","Data":"cdf2ff77c1275222fc6834169eed24a3bb49258161ae850a6aba5de97aee4a20"}
Jul 07 18:49:29.420076 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.420046    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:29.556744 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.556637    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util\") pod \"6be0fbdc-627a-44f1-a649-4cd083b892a8\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") "
Jul 07 18:49:29.556906 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.556755    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l6ktp\" (UniqueName: \"kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp\") pod \"6be0fbdc-627a-44f1-a649-4cd083b892a8\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") "
Jul 07 18:49:29.556906 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.556804    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle\") pod \"6be0fbdc-627a-44f1-a649-4cd083b892a8\" (UID: \"6be0fbdc-627a-44f1-a649-4cd083b892a8\") "
Jul 07 18:49:29.557415 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.557378    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle" (OuterVolumeSpecName: "bundle") pod "6be0fbdc-627a-44f1-a649-4cd083b892a8" (UID: "6be0fbdc-627a-44f1-a649-4cd083b892a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:29.559450 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.559420    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp" (OuterVolumeSpecName: "kube-api-access-l6ktp") pod "6be0fbdc-627a-44f1-a649-4cd083b892a8" (UID: "6be0fbdc-627a-44f1-a649-4cd083b892a8"). InnerVolumeSpecName "kube-api-access-l6ktp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:49:29.562355 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.562328    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util" (OuterVolumeSpecName: "util") pod "6be0fbdc-627a-44f1-a649-4cd083b892a8" (UID: "6be0fbdc-627a-44f1-a649-4cd083b892a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:29.657622 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.657589    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l6ktp\" (UniqueName: \"kubernetes.io/projected/6be0fbdc-627a-44f1-a649-4cd083b892a8-kube-api-access-l6ktp\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:29.657622 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.657618    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:29.657847 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.657632    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6be0fbdc-627a-44f1-a649-4cd083b892a8-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:29.961615 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:29.961587    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 18:49:30.291192 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:30.291121    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms"
Jul 07 18:49:30.291554 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:30.291111    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fppvms" event={"ID":"6be0fbdc-627a-44f1-a649-4cd083b892a8","Type":"ContainerDied","Data":"c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a"}
Jul 07 18:49:30.291554 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:30.291264    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c97cec41af5a74dc8c9ad0c1147d1c67b361fe876fc71d66706dbdbd1a79a70a"
Jul 07 18:49:32.299865 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:32.299824    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr" event={"ID":"8bdcf1dc-e9db-4029-a4a8-cc1525a96da4","Type":"ContainerStarted","Data":"8335394a125d436d648f34be967c694e8f12e5ea1bf8d4e71a594a1507be18e1"}
Jul 07 18:49:32.926678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:32.926627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:33.362630 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.362559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:33.543062 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543007    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-dc7nr" podStartSLOduration=2.829212041 podStartE2EDuration="5.542990279s" totalImagesPullingTime="2.713778238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:32.345552858 +0000 UTC m=+302.761844831" watchObservedRunningTime="2026-07-07 18:49:33.542990279 +0000 UTC m=+303.959282250"
Jul 07 18:49:33.543439 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543422    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r5ltp"]
Jul 07 18:49:33.543757 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543742    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="pull"
Jul 07 18:49:33.543834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543759    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="pull"
Jul 07 18:49:33.543834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543777    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="util"
Jul 07 18:49:33.543834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543785    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="util"
Jul 07 18:49:33.543834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543797    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="extract"
Jul 07 18:49:33.543834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543806    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="extract"
Jul 07 18:49:33.544073 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.543890    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="6be0fbdc-627a-44f1-a649-4cd083b892a8" containerName="extract"
Jul 07 18:49:33.546182 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.546153    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.548948 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.548927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rdhc4\""
Jul 07 18:49:33.557545 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.557519    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r5ltp"]
Jul 07 18:49:33.696086 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.696044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhvbh\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-kube-api-access-fhvbh\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.696279 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.696118    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-bound-sa-token\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.796961 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.796920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhvbh\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-kube-api-access-fhvbh\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.797154 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.796982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-bound-sa-token\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.806748 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.806715    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-bound-sa-token\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.806911 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.806891    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhvbh\" (UniqueName: \"kubernetes.io/projected/9585ce03-dade-40dc-9573-cdbe0f421316-kube-api-access-fhvbh\") pod \"cert-manager-55b4d954d5-r5ltp\" (UID: \"9585ce03-dade-40dc-9573-cdbe0f421316\") " pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.855717 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.855682    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r5ltp"
Jul 07 18:49:33.980966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:33.980939    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r5ltp"]
Jul 07 18:49:33.983634 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:33.983610    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9585ce03_dade_40dc_9573_cdbe0f421316.slice/crio-136da408dfbc1f7d630a7dfea5905c005c37da3b5898974ea7a5b7e4d2d9d368 WatchSource:0}: Error finding container 136da408dfbc1f7d630a7dfea5905c005c37da3b5898974ea7a5b7e4d2d9d368: Status 404 returned error can't find the container with id 136da408dfbc1f7d630a7dfea5905c005c37da3b5898974ea7a5b7e4d2d9d368
Jul 07 18:49:34.288148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:34.288064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:34.310350 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:34.310318    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r5ltp" event={"ID":"9585ce03-dade-40dc-9573-cdbe0f421316","Type":"ContainerStarted","Data":"62e43ba77f4a3daa1aa7249a07d9618f79925357dff1b195944eaf855906a3a0"}
Jul 07 18:49:34.310493 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:34.310361    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r5ltp" event={"ID":"9585ce03-dade-40dc-9573-cdbe0f421316","Type":"ContainerStarted","Data":"136da408dfbc1f7d630a7dfea5905c005c37da3b5898974ea7a5b7e4d2d9d368"}
Jul 07 18:49:34.332986 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:34.332934    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-r5ltp" podStartSLOduration=1.332918863 podStartE2EDuration="1.332918863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:49:34.331240501 +0000 UTC m=+304.747532475" watchObservedRunningTime="2026-07-07 18:49:34.332918863 +0000 UTC m=+304.749210835"
Jul 07 18:49:34.381083 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:34.381047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:41.037448 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:41.037417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:41.139654 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:41.139603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:43.223934 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.223903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:43.755246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.755208    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"]
Jul 07 18:49:43.760589 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.760570    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.763791 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.763768    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 18:49:43.764597 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.764580    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 18:49:43.764696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.764586    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-dhxqn\""
Jul 07 18:49:43.770786 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.770764    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"]
Jul 07 18:49:43.772776 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.772752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgcpk\" (UniqueName: \"kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.772889 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.772808    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.772963 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.772888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.874087 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.874051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgcpk\" (UniqueName: \"kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.874252 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.874124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.874252 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.874158    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.874491 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.874475    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.874536 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.874517    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:43.889030 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:43.889000    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgcpk\" (UniqueName: \"kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:44.070383 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.070311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:44.198172 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.198106    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"]
Jul 07 18:49:44.200201 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:44.200173    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode663e33b_a583_4e59_8533_9f820d49b363.slice/crio-5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372 WatchSource:0}: Error finding container 5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372: Status 404 returned error can't find the container with id 5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372
Jul 07 18:49:44.351596 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.351510    2578 generic.go:356] "Generic (PLEG): container finished" podID="e663e33b-a583-4e59-8533-9f820d49b363" containerID="dceb74a7a147ac833e2970067346fbbc303d9a8c1535d37168f62fbad29537b5" exitCode=0
Jul 07 18:49:44.351995 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.351589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2" event={"ID":"e663e33b-a583-4e59-8533-9f820d49b363","Type":"ContainerDied","Data":"dceb74a7a147ac833e2970067346fbbc303d9a8c1535d37168f62fbad29537b5"}
Jul 07 18:49:44.351995 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.351632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2" event={"ID":"e663e33b-a583-4e59-8533-9f820d49b363","Type":"ContainerStarted","Data":"5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372"}
Jul 07 18:49:44.352162 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:44.352144    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:49:45.357960 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:45.357929    2578 generic.go:356] "Generic (PLEG): container finished" podID="e663e33b-a583-4e59-8533-9f820d49b363" containerID="78ed868f3ab15968c057e05ddc5bbddc1d60c91463fa179f059a1a2139d432c9" exitCode=0
Jul 07 18:49:45.358447 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:45.357995    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2" event={"ID":"e663e33b-a583-4e59-8533-9f820d49b363","Type":"ContainerDied","Data":"78ed868f3ab15968c057e05ddc5bbddc1d60c91463fa179f059a1a2139d432c9"}
Jul 07 18:49:46.364399 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:46.364368    2578 generic.go:356] "Generic (PLEG): container finished" podID="e663e33b-a583-4e59-8533-9f820d49b363" containerID="07b636961f42539eeaa1bf6bb852c644c01f435641141c4587f6208d8be5a37f" exitCode=0
Jul 07 18:49:46.364787 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:46.364446    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2" event={"ID":"e663e33b-a583-4e59-8533-9f820d49b363","Type":"ContainerDied","Data":"07b636961f42539eeaa1bf6bb852c644c01f435641141c4587f6208d8be5a37f"}
Jul 07 18:49:47.490057 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.490031    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:47.500914 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.500898    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util\") pod \"e663e33b-a583-4e59-8533-9f820d49b363\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") "
Jul 07 18:49:47.500995 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.500980    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rgcpk\" (UniqueName: \"kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk\") pod \"e663e33b-a583-4e59-8533-9f820d49b363\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") "
Jul 07 18:49:47.501049 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.501035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle\") pod \"e663e33b-a583-4e59-8533-9f820d49b363\" (UID: \"e663e33b-a583-4e59-8533-9f820d49b363\") "
Jul 07 18:49:47.501714 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.501691    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle" (OuterVolumeSpecName: "bundle") pod "e663e33b-a583-4e59-8533-9f820d49b363" (UID: "e663e33b-a583-4e59-8533-9f820d49b363"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:47.503132 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.503112    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk" (OuterVolumeSpecName: "kube-api-access-rgcpk") pod "e663e33b-a583-4e59-8533-9f820d49b363" (UID: "e663e33b-a583-4e59-8533-9f820d49b363"). InnerVolumeSpecName "kube-api-access-rgcpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:49:47.506605 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.506586    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util" (OuterVolumeSpecName: "util") pod "e663e33b-a583-4e59-8533-9f820d49b363" (UID: "e663e33b-a583-4e59-8533-9f820d49b363"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:49:47.602113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.602086    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rgcpk\" (UniqueName: \"kubernetes.io/projected/e663e33b-a583-4e59-8533-9f820d49b363-kube-api-access-rgcpk\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:47.602113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.602111    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:47.602113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:47.602120    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e663e33b-a583-4e59-8533-9f820d49b363-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:49:48.378031 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:48.377949    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2"
Jul 07 18:49:48.378031 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:48.377982    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afp5nr2" event={"ID":"e663e33b-a583-4e59-8533-9f820d49b363","Type":"ContainerDied","Data":"5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372"}
Jul 07 18:49:48.378251 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:48.378039    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a456bf96437cbc3be16dfd9192a53400674150e8b7f8a48c1d603ba2c574372"
Jul 07 18:49:55.066314 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:55.066278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:55.163184 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:55.163150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:55.675819 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:55.675778    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:55.893078 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:55.893051    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:55.990969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:55.990883    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.040167 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040138    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"]
Jul 07 18:49:56.040421 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040410    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="util"
Jul 07 18:49:56.040466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040422    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="util"
Jul 07 18:49:56.040466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040432    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="pull"
Jul 07 18:49:56.040466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040438    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="pull"
Jul 07 18:49:56.040466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040448    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="extract"
Jul 07 18:49:56.040466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040453    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="extract"
Jul 07 18:49:56.040606 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.040521    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e663e33b-a583-4e59-8533-9f820d49b363" containerName="extract"
Jul 07 18:49:56.042414 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.042400    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.048312 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.048287    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 18:49:56.048902 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.048524    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 18:49:56.049246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.049227    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 18:49:56.049352 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.049273    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 18:49:56.049352 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.049336    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-mqw76\""
Jul 07 18:49:56.071524 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.071503    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"]
Jul 07 18:49:56.076171 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.076149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.076291 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.076180    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.076291 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.076196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.076291 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.076225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw6km\" (UniqueName: \"kubernetes.io/projected/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-kube-api-access-pw6km\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.076291 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.076284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.176910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.176874    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.176910 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.176907    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.177151 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.176934    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw6km\" (UniqueName: \"kubernetes.io/projected/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-kube-api-access-pw6km\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.177151 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.176955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.177151 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.177030    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.177698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.177671    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-manifests\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.179431 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.179409    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-webhook-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.179515 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.179458    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-tmp\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.179562 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.179546    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.186612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.186588    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw6km\" (UniqueName: \"kubernetes.io/projected/d52be4d5-67eb-49c8-a6ca-76bca7d7734d-kube-api-access-pw6km\") pod \"opendatahub-operator-controller-manager-545cccdbd8-mhvtj\" (UID: \"d52be4d5-67eb-49c8-a6ca-76bca7d7734d\") " pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.238256 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.238225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.334942 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.334858    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.352679 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.352659    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:49:56.437302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.437267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.487747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.487725    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"]
Jul 07 18:49:56.489412 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:49:56.489387    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd52be4d5_67eb_49c8_a6ca_76bca7d7734d.slice/crio-ba8860ef9b91f64aa90c5f568bd613ec2bbe92660821ce69953b11b41fd3d48e WatchSource:0}: Error finding container ba8860ef9b91f64aa90c5f568bd613ec2bbe92660821ce69953b11b41fd3d48e: Status 404 returned error can't find the container with id ba8860ef9b91f64aa90c5f568bd613ec2bbe92660821ce69953b11b41fd3d48e
Jul 07 18:49:56.539229 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.539195    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.635550 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.635469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:56.738866 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:56.738829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:57.423079 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:57.423042    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj" event={"ID":"d52be4d5-67eb-49c8-a6ca-76bca7d7734d","Type":"ContainerStarted","Data":"ba8860ef9b91f64aa90c5f568bd613ec2bbe92660821ce69953b11b41fd3d48e"}
Jul 07 18:49:59.489526 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:59.489498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:49:59.590170 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:49:59.590123    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:00.438788 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:00.438756    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj" event={"ID":"d52be4d5-67eb-49c8-a6ca-76bca7d7734d","Type":"ContainerStarted","Data":"d4ea22b196631cc330e4bb4a92a31f332976dabf2d5f34a03e8e33498842bef8"}
Jul 07 18:50:01.444723 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:01.444687    2578 generic.go:356] "Generic (PLEG): container finished" podID="d52be4d5-67eb-49c8-a6ca-76bca7d7734d" containerID="d4ea22b196631cc330e4bb4a92a31f332976dabf2d5f34a03e8e33498842bef8" exitCode=0
Jul 07 18:50:01.445159 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:01.444766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj" event={"ID":"d52be4d5-67eb-49c8-a6ca-76bca7d7734d","Type":"ContainerDied","Data":"d4ea22b196631cc330e4bb4a92a31f332976dabf2d5f34a03e8e33498842bef8"}
Jul 07 18:50:02.451456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:02.451364    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj" event={"ID":"d52be4d5-67eb-49c8-a6ca-76bca7d7734d","Type":"ContainerStarted","Data":"551d082c98917ebacce5c5d821c59341736adb1a27df0c72c8b3f9e5b3c6417a"}
Jul 07 18:50:02.451855 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:02.451466    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:50:02.478637 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:02.478583    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj" podStartSLOduration=1.781454612 podStartE2EDuration="6.478566192s" totalImagesPullingTime="3.617375158s" totalInitContainerRuntime="1.079736422s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:49:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:02.476041542 +0000 UTC m=+332.892333516" watchObservedRunningTime="2026-07-07 18:50:02.478566192 +0000 UTC m=+332.894858164"
Jul 07 18:50:13.458886 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:13.458849    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-545cccdbd8-mhvtj"
Jul 07 18:50:16.261215 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:16.261166    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:16.366002 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:16.365971    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:16.911966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:16.911936    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.038147 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.038104    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"]
Jul 07 18:50:17.048148 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.048118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.055562 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.055537    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 07 18:50:17.056459 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.056437    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 07 18:50:17.056963 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.056946    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-f86wh\""
Jul 07 18:50:17.065072 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.065048    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"]
Jul 07 18:50:17.071117 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.071092    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7d74d"]
Jul 07 18:50:17.073280 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.073262    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.075876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.075856    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Jul 07 18:50:17.075994 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.075865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-vzs4v\""
Jul 07 18:50:17.096753 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.096724    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7d74d"]
Jul 07 18:50:17.143118 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.143086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.165747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.165664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.165747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.165713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5050efce-31cf-450b-b23d-1536876602c1-tmp\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.165747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.165740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p954q\" (UniqueName: \"kubernetes.io/projected/5050efce-31cf-450b-b23d-1536876602c1-kube-api-access-p954q\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.165978 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.165767    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kk8s6\" (UniqueName: \"kubernetes.io/projected/264e3a05-34a1-4938-a276-0a9ab162ab99-kube-api-access-kk8s6\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.165978 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.165877    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.231227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.231191    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.266931 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.266901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kk8s6\" (UniqueName: \"kubernetes.io/projected/264e3a05-34a1-4938-a276-0a9ab162ab99-kube-api-access-kk8s6\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.266955    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.266995    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.267016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5050efce-31cf-450b-b23d-1536876602c1-tmp\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.267043    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p954q\" (UniqueName: \"kubernetes.io/projected/5050efce-31cf-450b-b23d-1536876602c1-kube-api-access-p954q\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:17.267142    2578 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:17.267193    2578 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:17.267235    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert podName:264e3a05-34a1-4938-a276-0a9ab162ab99 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:17.767215779 +0000 UTC m=+348.183507740 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert") pod "odh-model-controller-7998c67dc4-7d74d" (UID: "264e3a05-34a1-4938-a276-0a9ab162ab99") : secret "odh-model-controller-webhook-cert" not found
Jul 07 18:50:17.267349 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:17.267248    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs podName:5050efce-31cf-450b-b23d-1536876602c1 nodeName:}" failed. No retries permitted until 2026-07-07 18:50:17.767242942 +0000 UTC m=+348.183534893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs") pod "kube-auth-proxy-d58d67c5c-rzhcf" (UID: "5050efce-31cf-450b-b23d-1536876602c1") : secret "kube-auth-proxy-tls" not found
Jul 07 18:50:17.269155 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.269127    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5050efce-31cf-450b-b23d-1536876602c1-tmp\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.280573 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.280548    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p954q\" (UniqueName: \"kubernetes.io/projected/5050efce-31cf-450b-b23d-1536876602c1-kube-api-access-p954q\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.281287 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.281267    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kk8s6\" (UniqueName: \"kubernetes.io/projected/264e3a05-34a1-4938-a276-0a9ab162ab99-kube-api-access-kk8s6\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.335116 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.335085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.429634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.429542    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.561106 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.561065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.770165 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.770077    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.770317 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.770172    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.772589 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.772554    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/264e3a05-34a1-4938-a276-0a9ab162ab99-cert\") pod \"odh-model-controller-7998c67dc4-7d74d\" (UID: \"264e3a05-34a1-4938-a276-0a9ab162ab99\") " pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:17.772741 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.772622    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5050efce-31cf-450b-b23d-1536876602c1-tls-certs\") pod \"kube-auth-proxy-d58d67c5c-rzhcf\" (UID: \"5050efce-31cf-450b-b23d-1536876602c1\") " pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.938342 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.938305    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:17.958024 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.957997    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"
Jul 07 18:50:17.983469 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:17.983438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:18.053057 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.053015    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gwsc6"]
Jul 07 18:50:18.056882 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.056855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.059565 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.059541    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-zksp2\""
Jul 07 18:50:18.059701 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.059664    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jul 07 18:50:18.078548 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.078360    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gwsc6"]
Jul 07 18:50:18.103580 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.103469    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf"]
Jul 07 18:50:18.107569 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:18.107530    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5050efce_31cf_450b_b23d_1536876602c1.slice/crio-5e1caeb7b5af979afb6f86ee83e98271190c8535bb7fa69eb601c9f80d459afb WatchSource:0}: Error finding container 5e1caeb7b5af979afb6f86ee83e98271190c8535bb7fa69eb601c9f80d459afb: Status 404 returned error can't find the container with id 5e1caeb7b5af979afb6f86ee83e98271190c8535bb7fa69eb601c9f80d459afb
Jul 07 18:50:18.109168 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.109134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:18.128870 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.128847    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-7d74d"]
Jul 07 18:50:18.131277 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:18.131253    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod264e3a05_34a1_4938_a276_0a9ab162ab99.slice/crio-5eb4ecb9506254b5783e6f11d512b3a2a6c6487ff281b07365c2fa1079338647 WatchSource:0}: Error finding container 5eb4ecb9506254b5783e6f11d512b3a2a6c6487ff281b07365c2fa1079338647: Status 404 returned error can't find the container with id 5eb4ecb9506254b5783e6f11d512b3a2a6c6487ff281b07365c2fa1079338647
Jul 07 18:50:18.174242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.174209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vnmc\" (UniqueName: \"kubernetes.io/projected/67f37f3e-bba9-4f8c-8bff-c1633913f89e-kube-api-access-5vnmc\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.174402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.174247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f37f3e-bba9-4f8c-8bff-c1633913f89e-tls-certs\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.275268 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.275231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vnmc\" (UniqueName: \"kubernetes.io/projected/67f37f3e-bba9-4f8c-8bff-c1633913f89e-kube-api-access-5vnmc\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.275734 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.275275    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f37f3e-bba9-4f8c-8bff-c1633913f89e-tls-certs\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.276514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.276483    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:18.277984 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.277958    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/67f37f3e-bba9-4f8c-8bff-c1633913f89e-tls-certs\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.290195 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.290130    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vnmc\" (UniqueName: \"kubernetes.io/projected/67f37f3e-bba9-4f8c-8bff-c1633913f89e-kube-api-access-5vnmc\") pod \"model-serving-api-54d89bd5fc-gwsc6\" (UID: \"67f37f3e-bba9-4f8c-8bff-c1633913f89e\") " pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.373090 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.373054    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:18.374583 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.374558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:18.505041 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.505014    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-gwsc6"]
Jul 07 18:50:18.507303 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:18.507277    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67f37f3e_bba9_4f8c_8bff_c1633913f89e.slice/crio-f5ffed25a6ba56c547577d0bc8d76c0f051a3a09b6f02386934a501b0ef1e711 WatchSource:0}: Error finding container f5ffed25a6ba56c547577d0bc8d76c0f051a3a09b6f02386934a501b0ef1e711: Status 404 returned error can't find the container with id f5ffed25a6ba56c547577d0bc8d76c0f051a3a09b6f02386934a501b0ef1e711
Jul 07 18:50:18.529247 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.529221    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6" event={"ID":"67f37f3e-bba9-4f8c-8bff-c1633913f89e","Type":"ContainerStarted","Data":"f5ffed25a6ba56c547577d0bc8d76c0f051a3a09b6f02386934a501b0ef1e711"}
Jul 07 18:50:18.530300 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.530275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf" event={"ID":"5050efce-31cf-450b-b23d-1536876602c1","Type":"ContainerStarted","Data":"5e1caeb7b5af979afb6f86ee83e98271190c8535bb7fa69eb601c9f80d459afb"}
Jul 07 18:50:18.531234 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.531217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d" event={"ID":"264e3a05-34a1-4938-a276-0a9ab162ab99","Type":"ContainerStarted","Data":"5eb4ecb9506254b5783e6f11d512b3a2a6c6487ff281b07365c2fa1079338647"}
Jul 07 18:50:18.602624 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.602522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:18.686601 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:18.686552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:19.527615 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:19.527386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:21.510023 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.509981    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:21.575801 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.575757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:21.761607 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.761528    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:21.765237 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.765215    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.768087 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.768065    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 18:50:21.768215 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.768070    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6rjlq\""
Jul 07 18:50:21.778788 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.778762    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:21.795810 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.795776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:21.872281 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.872243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:21.909527 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzxwj\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909733 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909722    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909918 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909918 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:21.909918 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:21.909836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.010953 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.010913    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzxwj\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.010994    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011070    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011094    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011129 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011388 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011388 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011388 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011228    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011521 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011436    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011521 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011742 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011687    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.011742 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.011702    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.012161 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.012134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.013678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.013635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.013815 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.013798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.021519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.021495    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.022508 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.022489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzxwj\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj\") pod \"data-science-gateway-data-science-gateway-class-548557588-fxmpq\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.079403 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.079371    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:22.119616 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.119580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:22.556440 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.555879    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d" event={"ID":"264e3a05-34a1-4938-a276-0a9ab162ab99","Type":"ContainerStarted","Data":"bedbbe13993f0a413cc34c97dd651c7e152d83dae1ba95faf2992c7ed85f1d1a"}
Jul 07 18:50:22.556440 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.556140    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:22.558589 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.558015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6" event={"ID":"67f37f3e-bba9-4f8c-8bff-c1633913f89e","Type":"ContainerStarted","Data":"d8765324d47b469d72c71d50dcb36588bf16da6ea0fb829033107b496030f7a2"}
Jul 07 18:50:22.558589 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.558490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:22.561737 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.561705    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf" event={"ID":"5050efce-31cf-450b-b23d-1536876602c1","Type":"ContainerStarted","Data":"f81f46cfd426cbcaea81a27537f50f6ff9aad5a774a022dfe988455dd0eb6d94"}
Jul 07 18:50:22.577090 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.577034    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d" podStartSLOduration=1.256330323 podStartE2EDuration="5.577012652s" totalImagesPullingTime="4.320682329s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:22.575433721 +0000 UTC m=+352.991725694" watchObservedRunningTime="2026-07-07 18:50:22.577012652 +0000 UTC m=+352.993304629"
Jul 07 18:50:22.598336 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.598292    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-d58d67c5c-rzhcf" podStartSLOduration=1.256331622 podStartE2EDuration="5.598276675s" totalImagesPullingTime="4.341945053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:22.596981369 +0000 UTC m=+353.013273368" watchObservedRunningTime="2026-07-07 18:50:22.598276675 +0000 UTC m=+353.014568665"
Jul 07 18:50:22.602794 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.602773    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:22.605137 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:22.605087    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b84a36c_cd00_46f1_9b20_a62d80e60b9f.slice/crio-fb0a212e6b0c7df2ae01f59f31aa9dfdaffac970ddc593dd8999f2a8c587f49b WatchSource:0}: Error finding container fb0a212e6b0c7df2ae01f59f31aa9dfdaffac970ddc593dd8999f2a8c587f49b: Status 404 returned error can't find the container with id fb0a212e6b0c7df2ae01f59f31aa9dfdaffac970ddc593dd8999f2a8c587f49b
Jul 07 18:50:22.620847 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:22.620797    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6" podStartSLOduration=0.677271584 podStartE2EDuration="4.620782s" totalImagesPullingTime="3.943510416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:22.619079037 +0000 UTC m=+353.035371010" watchObservedRunningTime="2026-07-07 18:50:22.620782 +0000 UTC m=+353.037074010"
Jul 07 18:50:23.568047 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:23.568007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" event={"ID":"1b84a36c-cd00-46f1-9b20-a62d80e60b9f","Type":"ContainerStarted","Data":"fb0a212e6b0c7df2ae01f59f31aa9dfdaffac970ddc593dd8999f2a8c587f49b"}
Jul 07 18:50:24.960365 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:24.960326    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:50:24.960612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:24.960416    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:50:24.960612 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:24.960455    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:50:25.466361 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.466329    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"]
Jul 07 18:50:25.469566 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.469552    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.472844 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.472821    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 18:50:25.473107 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.473089    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 18:50:25.473198 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.473104    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2t2db\""
Jul 07 18:50:25.473723 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.473701    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 18:50:25.492282 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.492258    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"]
Jul 07 18:50:25.578708 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.578672    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" event={"ID":"1b84a36c-cd00-46f1-9b20-a62d80e60b9f","Type":"ContainerStarted","Data":"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"}
Jul 07 18:50:25.621113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.621062    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" podStartSLOduration=2.268487205 podStartE2EDuration="4.621048251s" totalImagesPullingTime="2.352561046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:25.619596407 +0000 UTC m=+356.035888383" watchObservedRunningTime="2026-07-07 18:50:25.621048251 +0000 UTC m=+356.037340225"
Jul 07 18:50:25.645949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.645914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.645978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.646071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646124 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.646119    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646262 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.646167    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gjc8\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-kube-api-access-8gjc8\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646262 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.646211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.646262 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.646234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.746918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747022 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gjc8\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-kube-api-access-8gjc8\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747242 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.747826 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.747798    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.749694 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.749622    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.749791 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.749726    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.749791 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.749724    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.749860 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.749797    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.756604 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.756586    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gjc8\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-kube-api-access-8gjc8\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.756834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.756814    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ff4337c5-ff73-4d2c-99a4-798ff7010ca3-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-4qmlh\" (UID: \"ff4337c5-ff73-4d2c-99a4-798ff7010ca3\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.780652 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.780623    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:25.915055 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:25.915023    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"]
Jul 07 18:50:25.917870 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:25.917839    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff4337c5_ff73_4d2c_99a4_798ff7010ca3.slice/crio-85f952d710f20b1e0ec9a3f779ae6529c591c09c2a47dcf000618ce397956d9a WatchSource:0}: Error finding container 85f952d710f20b1e0ec9a3f779ae6529c591c09c2a47dcf000618ce397956d9a: Status 404 returned error can't find the container with id 85f952d710f20b1e0ec9a3f779ae6529c591c09c2a47dcf000618ce397956d9a
Jul 07 18:50:26.079850 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:26.079776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:26.081239 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:26.081216    2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-fxmpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 07 18:50:26.081342 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:26.081261    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 07 18:50:26.329264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:26.329223    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:26.586318 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:26.586261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh" event={"ID":"ff4337c5-ff73-4d2c-99a4-798ff7010ca3","Type":"ContainerStarted","Data":"85f952d710f20b1e0ec9a3f779ae6529c591c09c2a47dcf000618ce397956d9a"}
Jul 07 18:50:27.080665 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:27.080607    2578 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-548557588-fxmpq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused" start-of-body=
Jul 07 18:50:27.081065 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:27.080706    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.31:15021/healthz/ready\": dial tcp 10.133.0.31:15021: connect: connection refused"
Jul 07 18:50:27.592988 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:27.592943    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy" containerID="cri-o://1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2" gracePeriod=30
Jul 07 18:50:27.931754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:27.931719    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:50:27.931841 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:27.931786    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:50:28.606502 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.606442    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh" event={"ID":"ff4337c5-ff73-4d2c-99a4-798ff7010ca3","Type":"ContainerStarted","Data":"961305b3914b653512a49f9fb617cf03737c6a689db18e2f0b5eee2aac063e74"}
Jul 07 18:50:28.607370 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.606619    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:28.608120 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.608082    2578 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-4qmlh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 18:50:28.608231 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.608138    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh" podUID="ff4337c5-ff73-4d2c-99a4-798ff7010ca3" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 18:50:28.641475 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.641425    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh" podStartSLOduration=1.629799067 podStartE2EDuration="3.641408448s" totalImagesPullingTime="2.011609381s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:28.639998977 +0000 UTC m=+359.056290987" watchObservedRunningTime="2026-07-07 18:50:28.641408448 +0000 UTC m=+359.057700421"
Jul 07 18:50:28.646678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.646627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:28.739029 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.738992    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:28.794538 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.794507    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"]
Jul 07 18:50:28.797836 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.797821    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:28.801021 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.800996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Jul 07 18:50:28.801271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.801254    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-4x5q9\""
Jul 07 18:50:28.811114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.811089    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"]
Jul 07 18:50:28.814270 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.814251    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:28.816657 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.816627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"]
Jul 07 18:50:28.819857 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.819835    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 07 18:50:28.819963 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.819876    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-qn4kp\""
Jul 07 18:50:28.838066 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.838041    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"]
Jul 07 18:50:28.851982 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.851953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:28.978342 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.978307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:28.978526 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.978506    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:28.978577 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.978536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnccv\" (UniqueName: \"kubernetes.io/projected/4a5b14b6-a505-4576-b725-f69047c2bcff-kube-api-access-vnccv\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:28.978577 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.978571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:28.978673 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:28.978606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnjvj\" (UniqueName: \"kubernetes.io/projected/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-kube-api-access-lnjvj\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.079948 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.079903    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnjvj\" (UniqueName: \"kubernetes.io/projected/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-kube-api-access-lnjvj\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.080121 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.079998    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.080121 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.080016    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnccv\" (UniqueName: \"kubernetes.io/projected/4a5b14b6-a505-4576-b725-f69047c2bcff-kube-api-access-vnccv\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.080121 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.080044    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.080229 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:29.080135    2578 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Jul 07 18:50:29.080229 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:29.080207    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert podName:4a5b14b6-a505-4576-b725-f69047c2bcff nodeName:}" failed. No retries permitted until 2026-07-07 18:50:29.580185766 +0000 UTC m=+359.996477729 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert") pod "llmisvc-controller-manager-777c6bd7d5-cmgvd" (UID: "4a5b14b6-a505-4576-b725-f69047c2bcff") : secret "llmisvc-webhook-server-cert" not found
Jul 07 18:50:29.082415 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.082388    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-cert\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.094513 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.094489    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnjvj\" (UniqueName: \"kubernetes.io/projected/6cf269fc-cbc2-4c1a-8a05-d7b5b169a983-kube-api-access-lnjvj\") pod \"kserve-controller-manager-d6f4b65b8-mh6rm\" (UID: \"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.097583 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.097559    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnccv\" (UniqueName: \"kubernetes.io/projected/4a5b14b6-a505-4576-b725-f69047c2bcff-kube-api-access-vnccv\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.108438 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.108421    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:29.251409 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.251331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:29.270945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.270915    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"]
Jul 07 18:50:29.272565 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:29.272541    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cf269fc_cbc2_4c1a_8a05_d7b5b169a983.slice/crio-1632679933d6c7276e36ceb32e2f24606198cbb85478756d5e46ade1a81c980e WatchSource:0}: Error finding container 1632679933d6c7276e36ceb32e2f24606198cbb85478756d5e46ade1a81c980e: Status 404 returned error can't find the container with id 1632679933d6c7276e36ceb32e2f24606198cbb85478756d5e46ade1a81c980e
Jul 07 18:50:29.583987 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.583897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.586300 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.586265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4a5b14b6-a505-4576-b725-f69047c2bcff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-cmgvd\" (UID: \"4a5b14b6-a505-4576-b725-f69047c2bcff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.612314 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.612282    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm" event={"ID":"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983","Type":"ContainerStarted","Data":"1632679933d6c7276e36ceb32e2f24606198cbb85478756d5e46ade1a81c980e"}
Jul 07 18:50:29.613049 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.613031    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-4qmlh"
Jul 07 18:50:29.724115 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.724080    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:50:29.855209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:29.855182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"]
Jul 07 18:50:29.856421 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:50:29.856400    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod4a5b14b6_a505_4576_b725_f69047c2bcff.slice/crio-97ec610b9d87fc021ac091b8701c27d05de07e45e616e0ba0d0ecc39eb7afdc4 WatchSource:0}: Error finding container 97ec610b9d87fc021ac091b8701c27d05de07e45e616e0ba0d0ecc39eb7afdc4: Status 404 returned error can't find the container with id 97ec610b9d87fc021ac091b8701c27d05de07e45e616e0ba0d0ecc39eb7afdc4
Jul 07 18:50:30.001071 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:30.001027    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:30.103729 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:30.103631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:30.194901 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:30.194771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:50:30.618165 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:30.618134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd" event={"ID":"4a5b14b6-a505-4576-b725-f69047c2bcff","Type":"ContainerStarted","Data":"97ec610b9d87fc021ac091b8701c27d05de07e45e616e0ba0d0ecc39eb7afdc4"}
Jul 07 18:50:32.851346 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.851294    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:32.912411 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912377    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912462    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912509    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912545    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzxwj\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912572    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912592    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912610    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.912811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912705    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo\") pod \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\" (UID: \"1b84a36c-cd00-46f1-9b20-a62d80e60b9f\") "
Jul 07 18:50:32.913010 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.912706    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:32.913063 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.913039    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:32.913063 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.913025    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:32.913362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.913326    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:50:32.913362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.913343    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:32.915488 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.915460    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 18:50:32.915607 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.915572    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:50:32.915700 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.915588    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj" (OuterVolumeSpecName: "kube-api-access-nzxwj") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "kube-api-access-nzxwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:50:32.916007 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:32.915987    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b84a36c-cd00-46f1-9b20-a62d80e60b9f" (UID: "1b84a36c-cd00-46f1-9b20-a62d80e60b9f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:50:33.013705 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013665    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013705 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013701    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013705 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013711    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013719    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013728    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013739    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzxwj\" (UniqueName: \"kubernetes.io/projected/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-kube-api-access-nzxwj\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013753    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013765    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.013926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.013778    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b84a36c-cd00-46f1-9b20-a62d80e60b9f-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:50:33.570391 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.570368    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-7d74d"
Jul 07 18:50:33.572461 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.572443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-gwsc6"
Jul 07 18:50:33.633506 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.633477    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerID="1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2" exitCode=0
Jul 07 18:50:33.633673 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.633520    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"
Jul 07 18:50:33.633673 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.633548    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" event={"ID":"1b84a36c-cd00-46f1-9b20-a62d80e60b9f","Type":"ContainerDied","Data":"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"}
Jul 07 18:50:33.633673 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.633595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq" event={"ID":"1b84a36c-cd00-46f1-9b20-a62d80e60b9f","Type":"ContainerDied","Data":"fb0a212e6b0c7df2ae01f59f31aa9dfdaffac970ddc593dd8999f2a8c587f49b"}
Jul 07 18:50:33.633673 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.633626    2578 scope.go:117] "RemoveContainer" containerID="1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"
Jul 07 18:50:33.635504 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.635474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm" event={"ID":"6cf269fc-cbc2-4c1a-8a05-d7b5b169a983","Type":"ContainerStarted","Data":"2b579e035154f4e8d1ba745ae7aed5cf4e3437f1f7d57b51e93a143eb7c82f17"}
Jul 07 18:50:33.635918 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.635689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:50:33.643971 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.643959    2578 scope.go:117] "RemoveContainer" containerID="1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"
Jul 07 18:50:33.644227 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:50:33.644207    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2\": container with ID starting with 1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2 not found: ID does not exist" containerID="1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"
Jul 07 18:50:33.644291 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.644233    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2"} err="failed to get container status \"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2\": rpc error: code = NotFound desc = could not find container \"1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2\": container with ID starting with 1f515199aed41a100382ade5e71c2bf47cf4ee58ba5d7a747df471ededa191e2 not found: ID does not exist"
Jul 07 18:50:33.708071 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.708048    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:33.714632 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.714609    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-548557588-fxmpq"]
Jul 07 18:50:33.737156 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:33.737109    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm" podStartSLOduration=2.337356997 podStartE2EDuration="5.737096265s" totalImagesPullingTime="3.399739268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:33.736093644 +0000 UTC m=+364.152385618" watchObservedRunningTime="2026-07-07 18:50:33.737096265 +0000 UTC m=+364.153388238"
Jul 07 18:50:34.070773 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:34.070740    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" path="/var/lib/kubelet/pods/1b84a36c-cd00-46f1-9b20-a62d80e60b9f/volumes"
Jul 07 18:50:34.642003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:34.641966    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd" event={"ID":"4a5b14b6-a505-4576-b725-f69047c2bcff","Type":"ContainerStarted","Data":"dde0d0a6c95999138d174ddb51daa4c64e8649196c34a96eaf1c01956122d41b"}
Jul 07 18:50:34.642328 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:50:34.642300    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:51:04.647572 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:04.647543    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-mh6rm"
Jul 07 18:51:04.669658 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:04.669600    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd" podStartSLOduration=32.976205477 podStartE2EDuration="36.669583578s" totalImagesPullingTime="3.693378101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:50:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:50:34.669706243 +0000 UTC m=+365.085998216" watchObservedRunningTime="2026-07-07 18:51:04.669583578 +0000 UTC m=+395.085875552"
Jul 07 18:51:06.654444 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:06.654408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-cmgvd"
Jul 07 18:51:17.707728 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:17.707687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:18.856328 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:18.856288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:22.468365 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:22.468328    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:22.527380 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:22.527345    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:33.071653 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.071618    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"]
Jul 07 18:51:33.072006 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.071952    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy"
Jul 07 18:51:33.072006 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.071962    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy"
Jul 07 18:51:33.072079 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.072033    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b84a36c-cd00-46f1-9b20-a62d80e60b9f" containerName="istio-proxy"
Jul 07 18:51:33.074811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.074796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.077567 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.077546    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:51:33.077727 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.077706    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-95977\""
Jul 07 18:51:33.077862 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.077843    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:51:33.086834 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.086812    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"]
Jul 07 18:51:33.150839 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.150802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.150980 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.150857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.150980 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.150936    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lqs\" (UniqueName: \"kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.252344 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.252313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.252479 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.252361    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.252479 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.252416    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lqs\" (UniqueName: \"kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.252825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.252803    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.252876 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.252823    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.265078 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.265056    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lqs\" (UniqueName: \"kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.384373 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.384298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:33.523753 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.523730    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"]
Jul 07 18:51:33.525575 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:51:33.525548    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1e568a7_ba9b_48f0_b210_e0b78a0a6627.slice/crio-253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161 WatchSource:0}: Error finding container 253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161: Status 404 returned error can't find the container with id 253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161
Jul 07 18:51:33.865897 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.865865    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"]
Jul 07 18:51:33.868299 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.868279    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:33.878356 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.878332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"]
Jul 07 18:51:33.922521 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.922491    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerID="e3e4c3e41d276c08e0a555425a36dde13af4b1f0ca96b1cbbb2d840b8470442d" exitCode=0
Jul 07 18:51:33.922750 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.922591    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn" event={"ID":"c1e568a7-ba9b-48f0-b210-e0b78a0a6627","Type":"ContainerDied","Data":"e3e4c3e41d276c08e0a555425a36dde13af4b1f0ca96b1cbbb2d840b8470442d"}
Jul 07 18:51:33.922750 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.922677    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn" event={"ID":"c1e568a7-ba9b-48f0-b210-e0b78a0a6627","Type":"ContainerStarted","Data":"253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161"}
Jul 07 18:51:33.959002 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.958970    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:33.959164 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.959010    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:33.959164 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:33.959121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86s4d\" (UniqueName: \"kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.060481 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.060445    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86s4d\" (UniqueName: \"kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.060675 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.060496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.060675 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.060537    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.060920 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.060900    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.060957 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.060923    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.070187 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.070163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86s4d\" (UniqueName: \"kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.176985 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.176951    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:34.269418 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.269388    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"]
Jul 07 18:51:34.273284 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.273263    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.281039 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.281007    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"]
Jul 07 18:51:34.307433 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.307412    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"]
Jul 07 18:51:34.309295 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:51:34.309271    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod974f1e9f_bd89_4a06_8694_02388b9d39d0.slice/crio-516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c WatchSource:0}: Error finding container 516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c: Status 404 returned error can't find the container with id 516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c
Jul 07 18:51:34.363373 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.363344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bjql\" (UniqueName: \"kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.363480 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.363400    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.363480 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.363461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.464255 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.464168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.464255 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.464225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.464481 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.464278    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bjql\" (UniqueName: \"kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.464630 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.464607    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.464630 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.464621    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.474451 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.474424    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bjql\" (UniqueName: \"kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.590413 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.590380    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:34.662464 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.662434    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"]
Jul 07 18:51:34.667172 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.667145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.676371 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.676310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"]
Jul 07 18:51:34.750142 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.750107    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"]
Jul 07 18:51:34.756457 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:51:34.756426    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b64c2f3_2190_4987_849b_bccb97869565.slice/crio-7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64 WatchSource:0}: Error finding container 7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64: Status 404 returned error can't find the container with id 7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64
Jul 07 18:51:34.766869 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.766847    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.766969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.766884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.766969 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.766903    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gw2n\" (UniqueName: \"kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.867747 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.867714    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.867878 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.867763    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.867878 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.867784    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gw2n\" (UniqueName: \"kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.868109 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.868090    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.868146 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.868101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.879091 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.879071    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gw2n\" (UniqueName: \"kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:34.928882 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.928850    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b64c2f3-2190-4987-849b-bccb97869565" containerID="74bd674387cef51ded84dd26c4a9b29dfa8d9608ed676476c36049d0d04e6838" exitCode=0
Jul 07 18:51:34.929017 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.928935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg" event={"ID":"7b64c2f3-2190-4987-849b-bccb97869565","Type":"ContainerDied","Data":"74bd674387cef51ded84dd26c4a9b29dfa8d9608ed676476c36049d0d04e6838"}
Jul 07 18:51:34.929017 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.928987    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg" event={"ID":"7b64c2f3-2190-4987-849b-bccb97869565","Type":"ContainerStarted","Data":"7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64"}
Jul 07 18:51:34.930838 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.930808    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerID="e2b737640c39425a567316b9b415f31b0916ffd7ecff4655d2c08b9c678df23f" exitCode=0
Jul 07 18:51:34.931050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.930893    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn" event={"ID":"c1e568a7-ba9b-48f0-b210-e0b78a0a6627","Type":"ContainerDied","Data":"e2b737640c39425a567316b9b415f31b0916ffd7ecff4655d2c08b9c678df23f"}
Jul 07 18:51:34.932557 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.932534    2578 generic.go:356] "Generic (PLEG): container finished" podID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerID="f5fdf8cabdbed147cac1383aafc9294294b188cfe8b9ab0f459cd70825d5134e" exitCode=0
Jul 07 18:51:34.932670 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.932574    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p" event={"ID":"974f1e9f-bd89-4a06-8694-02388b9d39d0","Type":"ContainerDied","Data":"f5fdf8cabdbed147cac1383aafc9294294b188cfe8b9ab0f459cd70825d5134e"}
Jul 07 18:51:34.932670 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.932611    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p" event={"ID":"974f1e9f-bd89-4a06-8694-02388b9d39d0","Type":"ContainerStarted","Data":"516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c"}
Jul 07 18:51:34.983456 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:34.983425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:35.123652 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.123619    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"]
Jul 07 18:51:35.125361 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:51:35.125338    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07ed186a_bccc_4b23_bd98_24e1f355e19c.slice/crio-572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be WatchSource:0}: Error finding container 572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be: Status 404 returned error can't find the container with id 572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be
Jul 07 18:51:35.938940 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.938902    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b64c2f3-2190-4987-849b-bccb97869565" containerID="b3f4307f39267a0c59d3821f2b9cb7c434e09b84fc25d812e50f752646c09c5f" exitCode=0
Jul 07 18:51:35.939407 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.938996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg" event={"ID":"7b64c2f3-2190-4987-849b-bccb97869565","Type":"ContainerDied","Data":"b3f4307f39267a0c59d3821f2b9cb7c434e09b84fc25d812e50f752646c09c5f"}
Jul 07 18:51:35.941211 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.941192    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerID="c617d8694595dfa5530eba4ca242dd410953a90d8d396d02b5fecb037e5aa664" exitCode=0
Jul 07 18:51:35.941319 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.941279    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn" event={"ID":"c1e568a7-ba9b-48f0-b210-e0b78a0a6627","Type":"ContainerDied","Data":"c617d8694595dfa5530eba4ca242dd410953a90d8d396d02b5fecb037e5aa664"}
Jul 07 18:51:35.943031 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.943003    2578 generic.go:356] "Generic (PLEG): container finished" podID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerID="2d11b6e9eaa73743f7bb31eafe0c7bec892016c14ad3c693c70076f2fb2812ce" exitCode=0
Jul 07 18:51:35.943092 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.943055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p" event={"ID":"974f1e9f-bd89-4a06-8694-02388b9d39d0","Type":"ContainerDied","Data":"2d11b6e9eaa73743f7bb31eafe0c7bec892016c14ad3c693c70076f2fb2812ce"}
Jul 07 18:51:35.944587 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.944566    2578 generic.go:356] "Generic (PLEG): container finished" podID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerID="ab91755c8c8cbf9c8eff58454e4a3909301d40ffbb1bef07990b82622436f7f1" exitCode=0
Jul 07 18:51:35.944709 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.944594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7" event={"ID":"07ed186a-bccc-4b23-bd98-24e1f355e19c","Type":"ContainerDied","Data":"ab91755c8c8cbf9c8eff58454e4a3909301d40ffbb1bef07990b82622436f7f1"}
Jul 07 18:51:35.944709 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:35.944635    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7" event={"ID":"07ed186a-bccc-4b23-bd98-24e1f355e19c","Type":"ContainerStarted","Data":"572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be"}
Jul 07 18:51:36.953107 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.953072    2578 generic.go:356] "Generic (PLEG): container finished" podID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerID="00d1354e49c9c96f880681e6129cbcee860d153698512aac6bc6b1da27ef3769" exitCode=0
Jul 07 18:51:36.953501 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.953119    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p" event={"ID":"974f1e9f-bd89-4a06-8694-02388b9d39d0","Type":"ContainerDied","Data":"00d1354e49c9c96f880681e6129cbcee860d153698512aac6bc6b1da27ef3769"}
Jul 07 18:51:36.954845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.954819    2578 generic.go:356] "Generic (PLEG): container finished" podID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerID="bddbd141166d2e1866e76cfcda7a25f31214513a21218aa9df3b27fad7217732" exitCode=0
Jul 07 18:51:36.954990 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.954897    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7" event={"ID":"07ed186a-bccc-4b23-bd98-24e1f355e19c","Type":"ContainerDied","Data":"bddbd141166d2e1866e76cfcda7a25f31214513a21218aa9df3b27fad7217732"}
Jul 07 18:51:36.957139 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.957120    2578 generic.go:356] "Generic (PLEG): container finished" podID="7b64c2f3-2190-4987-849b-bccb97869565" containerID="6fbcaa1395de28b0abc3518b0dadf8e39730ae395e30e20093d594e841af458a" exitCode=0
Jul 07 18:51:36.957244 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:36.957147    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg" event={"ID":"7b64c2f3-2190-4987-849b-bccb97869565","Type":"ContainerDied","Data":"6fbcaa1395de28b0abc3518b0dadf8e39730ae395e30e20093d594e841af458a"}
Jul 07 18:51:37.092738 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.092708    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:37.187131 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.187096    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util\") pod \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") "
Jul 07 18:51:37.187302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.187185    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle\") pod \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") "
Jul 07 18:51:37.187302 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.187216    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b9lqs\" (UniqueName: \"kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs\") pod \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\" (UID: \"c1e568a7-ba9b-48f0-b210-e0b78a0a6627\") "
Jul 07 18:51:37.187666 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.187606    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle" (OuterVolumeSpecName: "bundle") pod "c1e568a7-ba9b-48f0-b210-e0b78a0a6627" (UID: "c1e568a7-ba9b-48f0-b210-e0b78a0a6627"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:37.189359 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.189338    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs" (OuterVolumeSpecName: "kube-api-access-b9lqs") pod "c1e568a7-ba9b-48f0-b210-e0b78a0a6627" (UID: "c1e568a7-ba9b-48f0-b210-e0b78a0a6627"). InnerVolumeSpecName "kube-api-access-b9lqs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:37.192454 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.192433    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util" (OuterVolumeSpecName: "util") pod "c1e568a7-ba9b-48f0-b210-e0b78a0a6627" (UID: "c1e568a7-ba9b-48f0-b210-e0b78a0a6627"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:37.288113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.288079    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:37.288113 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.288112    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:37.288253 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.288121    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b9lqs\" (UniqueName: \"kubernetes.io/projected/c1e568a7-ba9b-48f0-b210-e0b78a0a6627-kube-api-access-b9lqs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:37.964528 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.964493    2578 generic.go:356] "Generic (PLEG): container finished" podID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerID="3212036aea382e79e4dcffb2c01d167c730cd884a6c04baaa36c46bc6539e628" exitCode=0
Jul 07 18:51:37.964915 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.964571    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7" event={"ID":"07ed186a-bccc-4b23-bd98-24e1f355e19c","Type":"ContainerDied","Data":"3212036aea382e79e4dcffb2c01d167c730cd884a6c04baaa36c46bc6539e628"}
Jul 07 18:51:37.966320 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.966293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn" event={"ID":"c1e568a7-ba9b-48f0-b210-e0b78a0a6627","Type":"ContainerDied","Data":"253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161"}
Jul 07 18:51:37.966435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.966326    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn"
Jul 07 18:51:37.966435 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:37.966333    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="253d6b6f17372f28123c51e6ed638f2b95de083dab5169e3eec04f01527c7161"
Jul 07 18:51:38.126434 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.126404    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:38.129123 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.129103    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:38.196849 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.196821    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util\") pod \"974f1e9f-bd89-4a06-8694-02388b9d39d0\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") "
Jul 07 18:51:38.196849 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.196856    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle\") pod \"7b64c2f3-2190-4987-849b-bccb97869565\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") "
Jul 07 18:51:38.197093 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.196888    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8bjql\" (UniqueName: \"kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql\") pod \"7b64c2f3-2190-4987-849b-bccb97869565\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") "
Jul 07 18:51:38.197093 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.196977    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util\") pod \"7b64c2f3-2190-4987-849b-bccb97869565\" (UID: \"7b64c2f3-2190-4987-849b-bccb97869565\") "
Jul 07 18:51:38.197093 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.197012    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle\") pod \"974f1e9f-bd89-4a06-8694-02388b9d39d0\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") "
Jul 07 18:51:38.197093 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.197054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86s4d\" (UniqueName: \"kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d\") pod \"974f1e9f-bd89-4a06-8694-02388b9d39d0\" (UID: \"974f1e9f-bd89-4a06-8694-02388b9d39d0\") "
Jul 07 18:51:38.197782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.197744    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle" (OuterVolumeSpecName: "bundle") pod "974f1e9f-bd89-4a06-8694-02388b9d39d0" (UID: "974f1e9f-bd89-4a06-8694-02388b9d39d0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:38.197907 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.197847    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle" (OuterVolumeSpecName: "bundle") pod "7b64c2f3-2190-4987-849b-bccb97869565" (UID: "7b64c2f3-2190-4987-849b-bccb97869565"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:38.199051 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.199025    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql" (OuterVolumeSpecName: "kube-api-access-8bjql") pod "7b64c2f3-2190-4987-849b-bccb97869565" (UID: "7b64c2f3-2190-4987-849b-bccb97869565"). InnerVolumeSpecName "kube-api-access-8bjql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:38.199298 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.199275    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d" (OuterVolumeSpecName: "kube-api-access-86s4d") pod "974f1e9f-bd89-4a06-8694-02388b9d39d0" (UID: "974f1e9f-bd89-4a06-8694-02388b9d39d0"). InnerVolumeSpecName "kube-api-access-86s4d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:38.205209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.205183    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util" (OuterVolumeSpecName: "util") pod "974f1e9f-bd89-4a06-8694-02388b9d39d0" (UID: "974f1e9f-bd89-4a06-8694-02388b9d39d0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:38.206631 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.206602    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util" (OuterVolumeSpecName: "util") pod "7b64c2f3-2190-4987-849b-bccb97869565" (UID: "7b64c2f3-2190-4987-849b-bccb97869565"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298394    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298423    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298434    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8bjql\" (UniqueName: \"kubernetes.io/projected/7b64c2f3-2190-4987-849b-bccb97869565-kube-api-access-8bjql\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298442    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7b64c2f3-2190-4987-849b-bccb97869565-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298450    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/974f1e9f-bd89-4a06-8694-02388b9d39d0-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.298478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.298460    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86s4d\" (UniqueName: \"kubernetes.io/projected/974f1e9f-bd89-4a06-8694-02388b9d39d0-kube-api-access-86s4d\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:38.972122 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.972091    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p"
Jul 07 18:51:38.972122 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.972104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p" event={"ID":"974f1e9f-bd89-4a06-8694-02388b9d39d0","Type":"ContainerDied","Data":"516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c"}
Jul 07 18:51:38.972552 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.972147    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="516e39e1fbbfb063eaf4e669b2ba5d77997d23e4255b272cc77c60d84db2055c"
Jul 07 18:51:38.973856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.973840    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg"
Jul 07 18:51:38.973945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.973880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg" event={"ID":"7b64c2f3-2190-4987-849b-bccb97869565","Type":"ContainerDied","Data":"7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64"}
Jul 07 18:51:38.973945 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:38.973912    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7068e54a44c0caf2f23051cfbc32e71b765541fc0da0c882d9bc2766d84b4a64"
Jul 07 18:51:39.105878 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.105851    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:39.205801 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.205766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util\") pod \"07ed186a-bccc-4b23-bd98-24e1f355e19c\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") "
Jul 07 18:51:39.205977 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.205810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9gw2n\" (UniqueName: \"kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n\") pod \"07ed186a-bccc-4b23-bd98-24e1f355e19c\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") "
Jul 07 18:51:39.205977 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.205870    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle\") pod \"07ed186a-bccc-4b23-bd98-24e1f355e19c\" (UID: \"07ed186a-bccc-4b23-bd98-24e1f355e19c\") "
Jul 07 18:51:39.206497 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.206470    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle" (OuterVolumeSpecName: "bundle") pod "07ed186a-bccc-4b23-bd98-24e1f355e19c" (UID: "07ed186a-bccc-4b23-bd98-24e1f355e19c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:39.207955 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.207933    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n" (OuterVolumeSpecName: "kube-api-access-9gw2n") pod "07ed186a-bccc-4b23-bd98-24e1f355e19c" (UID: "07ed186a-bccc-4b23-bd98-24e1f355e19c"). InnerVolumeSpecName "kube-api-access-9gw2n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:51:39.212133 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.212105    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util" (OuterVolumeSpecName: "util") pod "07ed186a-bccc-4b23-bd98-24e1f355e19c" (UID: "07ed186a-bccc-4b23-bd98-24e1f355e19c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 18:51:39.307525 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.307447    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-util\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:39.307525 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.307473    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9gw2n\" (UniqueName: \"kubernetes.io/projected/07ed186a-bccc-4b23-bd98-24e1f355e19c-kube-api-access-9gw2n\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:39.307525 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.307483    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/07ed186a-bccc-4b23-bd98-24e1f355e19c-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:51:39.622585 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.622505    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.723204 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.723165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:39.980730 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.980702    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7"
Jul 07 18:51:39.981114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.980698    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7" event={"ID":"07ed186a-bccc-4b23-bd98-24e1f355e19c","Type":"ContainerDied","Data":"572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be"}
Jul 07 18:51:39.981114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:39.980822    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="572b3510342a2cf80c92d6800b8e7cb7d401de67ddfdf84600ad90bc87f636be"
Jul 07 18:51:41.683586 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:41.683546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:41.739959 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:41.739922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:47.074967 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:47.074922    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:50.705412 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:50.705372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:50.804462 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:50.804403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:54.861509 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:54.861439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:55.260792 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:55.260757    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:56.709516 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:56.709480    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:57.107711 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.107603    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"]
Jul 07 18:51:57.107973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.107960    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="pull"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.107974    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="pull"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.107984    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="util"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.107990    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="util"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108003    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="pull"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108008    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="pull"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108014    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="extract"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108019    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="extract"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108026    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="util"
Jul 07 18:51:57.108027 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108031    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="util"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108036    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108041    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108050    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="util"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108055    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="util"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108060    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108065    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108076    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="util"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108080    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="util"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108086    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="pull"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108091    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="pull"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108096    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108102    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108109    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="pull"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108114    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="pull"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108162    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b64c2f3-2190-4987-849b-bccb97869565" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108170    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="07ed186a-bccc-4b23-bd98-24e1f355e19c" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108177    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="974f1e9f-bd89-4a06-8694-02388b9d39d0" containerName="extract"
Jul 07 18:51:57.108340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.108185    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1e568a7-ba9b-48f0-b210-e0b78a0a6627" containerName="extract"
Jul 07 18:51:57.109947 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.109925    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:51:57.112607 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.112588    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 18:51:57.112734 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.112715    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bkss2\""
Jul 07 18:51:57.113784 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.113767    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 18:51:57.122337 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.122316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"]
Jul 07 18:51:57.263816 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.263784    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-57l94\" (UniqueName: \"kubernetes.io/projected/a1c4fa8e-8bbb-49a2-a824-fff73dc14693-kube-api-access-57l94\") pod \"authorino-operator-75cc8d5cb7-2lpp5\" (UID: \"a1c4fa8e-8bbb-49a2-a824-fff73dc14693\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:51:57.364576 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.364476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-57l94\" (UniqueName: \"kubernetes.io/projected/a1c4fa8e-8bbb-49a2-a824-fff73dc14693-kube-api-access-57l94\") pod \"authorino-operator-75cc8d5cb7-2lpp5\" (UID: \"a1c4fa8e-8bbb-49a2-a824-fff73dc14693\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:51:57.373841 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.373812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-57l94\" (UniqueName: \"kubernetes.io/projected/a1c4fa8e-8bbb-49a2-a824-fff73dc14693-kube-api-access-57l94\") pod \"authorino-operator-75cc8d5cb7-2lpp5\" (UID: \"a1c4fa8e-8bbb-49a2-a824-fff73dc14693\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:51:57.420205 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.420176    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:51:57.557226 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:57.557203    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"]
Jul 07 18:51:57.559460 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:51:57.559432    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1c4fa8e_8bbb_49a2_a824_fff73dc14693.slice/crio-c1f8f9b9f7f66cd782adfb2f0f0684d1f97327240e5712e528a3dba72312c5ed WatchSource:0}: Error finding container c1f8f9b9f7f66cd782adfb2f0f0684d1f97327240e5712e528a3dba72312c5ed: Status 404 returned error can't find the container with id c1f8f9b9f7f66cd782adfb2f0f0684d1f97327240e5712e528a3dba72312c5ed
Jul 07 18:51:58.079720 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:58.079687    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5" event={"ID":"a1c4fa8e-8bbb-49a2-a824-fff73dc14693","Type":"ContainerStarted","Data":"c1f8f9b9f7f66cd782adfb2f0f0684d1f97327240e5712e528a3dba72312c5ed"}
Jul 07 18:51:58.278678 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:58.278618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:59.106413 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:59.106370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:51:59.197742 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:51:59.197633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:00.093602 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:00.093509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5" event={"ID":"a1c4fa8e-8bbb-49a2-a824-fff73dc14693","Type":"ContainerStarted","Data":"7690ea83b9a1113fd7a07abea6ef2ee9418ec08dcd21ff300c05d0f0d57e6315"}
Jul 07 18:52:00.093782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:00.093684    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:52:00.115161 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:00.115110    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5" podStartSLOduration=0.984234459 podStartE2EDuration="3.115094459s" totalImagesPullingTime="2.13086s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:51:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:00.112707476 +0000 UTC m=+450.528999454" watchObservedRunningTime="2026-07-07 18:52:00.115094459 +0000 UTC m=+450.531386431"
Jul 07 18:52:01.102204 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:01.102160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:02.494585 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:02.494543    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:02.594277 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:02.594243    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:04.788833 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:04.788797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.343443 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.343410    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.476208 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.476172    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-fc5bcdb7c-p95fc"]
Jul 07 18:52:05.478749 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.478732    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.494423 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.494399    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc5bcdb7c-p95fc"]
Jul 07 18:52:05.527836 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.527809    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-trusted-ca-bundle\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.527836 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.527839    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-oauth-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.528098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.527857    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4lqxn\" (UniqueName: \"kubernetes.io/projected/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-kube-api-access-4lqxn\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.528098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.527881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-service-ca\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.528098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.527991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-oauth-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.528098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.528036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.528098 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.528072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.546567 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.546534    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.607880 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.607789    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.629223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-trusted-ca-bundle\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-oauth-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629248    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4lqxn\" (UniqueName: \"kubernetes.io/projected/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-kube-api-access-4lqxn\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-service-ca\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-oauth-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629346    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.629402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.629378    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.630068 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.630042    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-service-ca\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.630172 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.630092    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-oauth-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.630248 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.630181    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-trusted-ca-bundle\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.630248 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.630215    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.632123 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.632101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-serving-cert\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.632201 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.632101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-console-oauth-config\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.654050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.654027    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4lqxn\" (UniqueName: \"kubernetes.io/projected/5766ed8f-be55-4b4a-8375-9abd7f1f6b44-kube-api-access-4lqxn\") pod \"console-fc5bcdb7c-p95fc\" (UID: \"5766ed8f-be55-4b4a-8375-9abd7f1f6b44\") " pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.683460 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.683430    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.754330 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.754294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:05.788239 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.788207    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:05.922510 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:05.922484    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-fc5bcdb7c-p95fc"]
Jul 07 18:52:05.924044 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:52:05.924017    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5766ed8f_be55_4b4a_8375_9abd7f1f6b44.slice/crio-ffdc132277be0a3f6e80cfc8a36ac92ddb417de5d0addf3e260790d9b619872f WatchSource:0}: Error finding container ffdc132277be0a3f6e80cfc8a36ac92ddb417de5d0addf3e260790d9b619872f: Status 404 returned error can't find the container with id ffdc132277be0a3f6e80cfc8a36ac92ddb417de5d0addf3e260790d9b619872f
Jul 07 18:52:06.125812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:06.125734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc5bcdb7c-p95fc" event={"ID":"5766ed8f-be55-4b4a-8375-9abd7f1f6b44","Type":"ContainerStarted","Data":"9f9c7572751d9ae0148eb997bae738017913c6cf50e3043a1a7ba6eafe7f917c"}
Jul 07 18:52:06.125812 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:06.125783    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-fc5bcdb7c-p95fc" event={"ID":"5766ed8f-be55-4b4a-8375-9abd7f1f6b44","Type":"ContainerStarted","Data":"ffdc132277be0a3f6e80cfc8a36ac92ddb417de5d0addf3e260790d9b619872f"}
Jul 07 18:52:06.153494 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:06.153443    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-fc5bcdb7c-p95fc" podStartSLOduration=1.153424753 podStartE2EDuration="1.153424753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:06.153330772 +0000 UTC m=+456.569622750" watchObservedRunningTime="2026-07-07 18:52:06.153424753 +0000 UTC m=+456.569716723"
Jul 07 18:52:06.285614 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:06.285585    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:06.391794 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:06.391696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:11.101339 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:11.101270    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-2lpp5"
Jul 07 18:52:14.520372 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:14.520333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:14.624798 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:14.624765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:15.789231 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:15.789192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:15.789698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:15.789253    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:15.794136 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:15.794115    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:16.181082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:16.181054    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-fc5bcdb7c-p95fc"
Jul 07 18:52:16.257082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:16.257050    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:52:16.422681 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:16.422618    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:16.520035 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:16.519950    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:16.616552 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:16.616517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:17.004783 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:17.004748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:17.108099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:17.108068    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:21.277354 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:21.277321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:21.378553 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:21.378517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:23.706534 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:23.706492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:23.779452 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:23.779419    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:32.533564 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:32.533513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:32.629344 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:32.629311    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:35.007811 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:35.007775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:35.106073 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:35.106041    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:39.339206 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:39.339165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:39.439597 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:39.439558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:41.286069 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.286029    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-655b6ff544-sc8lc" podUID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" containerName="console" containerID="cri-o://a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a" gracePeriod=15
Jul 07 18:52:41.540363 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.540305    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:52:41.660908 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.660873    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.660933    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.660975    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661054    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vc66k\" (UniqueName: \"kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661385 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle\") pod \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\" (UID: \"89ee4df3-3ab6-4e04-ae57-8d03d8775e14\") "
Jul 07 18:52:41.661466 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661431    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:41.661568 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661539    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config" (OuterVolumeSpecName: "console-config") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:41.661707 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661594    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:41.661707 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.661625    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca" (OuterVolumeSpecName: "service-ca") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:52:41.663340 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.663310    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:41.663604 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.663586    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:52:41.663692 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.663602    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k" (OuterVolumeSpecName: "kube-api-access-vc66k") pod "89ee4df3-3ab6-4e04-ae57-8d03d8775e14" (UID: "89ee4df3-3ab6-4e04-ae57-8d03d8775e14"). InnerVolumeSpecName "kube-api-access-vc66k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:52:41.762194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762162    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762188    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762197    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vc66k\" (UniqueName: \"kubernetes.io/projected/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-kube-api-access-vc66k\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762420 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762205    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-trusted-ca-bundle\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762420 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762214    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762420 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762222    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-oauth-serving-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:41.762420 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:41.762236    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/89ee4df3-3ab6-4e04-ae57-8d03d8775e14-console-oauth-config\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:52:42.311288 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.311254    2578 generic.go:356] "Generic (PLEG): container finished" podID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" containerID="a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a" exitCode=0
Jul 07 18:52:42.311782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.311296    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-655b6ff544-sc8lc"
Jul 07 18:52:42.311782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.311329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6ff544-sc8lc" event={"ID":"89ee4df3-3ab6-4e04-ae57-8d03d8775e14","Type":"ContainerDied","Data":"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"}
Jul 07 18:52:42.311782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.311374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-655b6ff544-sc8lc" event={"ID":"89ee4df3-3ab6-4e04-ae57-8d03d8775e14","Type":"ContainerDied","Data":"08f545b0a766402159f3a038b16f9066cb5c734a9c5c48fb9e309a86709f674d"}
Jul 07 18:52:42.311782 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.311395    2578 scope.go:117] "RemoveContainer" containerID="a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"
Jul 07 18:52:42.320588 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.320567    2578 scope.go:117] "RemoveContainer" containerID="a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"
Jul 07 18:52:42.320892 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:52:42.320871    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a\": container with ID starting with a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a not found: ID does not exist" containerID="a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"
Jul 07 18:52:42.320973 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.320899    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a"} err="failed to get container status \"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a\": rpc error: code = NotFound desc = could not find container \"a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a\": container with ID starting with a6ba06f54cd08bc33be64e26b57e35fe4913b3cef1e9da4205fa94fd0951794a not found: ID does not exist"
Jul 07 18:52:42.340574 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.338890    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:52:42.355608 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:42.355583    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-655b6ff544-sc8lc"]
Jul 07 18:52:43.156913 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:43.156882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:43.227534 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:43.227495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:44.071106 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.071069    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" path="/var/lib/kubelet/pods/89ee4df3-3ab6-4e04-ae57-8d03d8775e14/volumes"
Jul 07 18:52:44.542976 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.542944    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"]
Jul 07 18:52:44.543362 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.543345    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" containerName="console"
Jul 07 18:52:44.543463 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.543364    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" containerName="console"
Jul 07 18:52:44.543463 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.543456    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="89ee4df3-3ab6-4e04-ae57-8d03d8775e14" containerName="console"
Jul 07 18:52:44.548075 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.548055    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.550990 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.550969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-6jcbk\""
Jul 07 18:52:44.563994 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.563971    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"]
Jul 07 18:52:44.592054 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.592020    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:44.688001 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.687966    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688001 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688002    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688227 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7c9rm\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-kube-api-access-7c9rm\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688414 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.688414 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.688289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789478 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789502    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789541    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789558    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7c9rm\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-kube-api-access-7c9rm\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789754 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789585    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789931    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.789966 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789933    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.790159 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.789976    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.790159 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.790067    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.790296 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.790275    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.790337 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.790321    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.791987 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.791965    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.792192 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.792174    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.807951 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.807894    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.808255 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.808234    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7c9rm\" (UniqueName: \"kubernetes.io/projected/2e5743d8-6fd2-4656-9b9a-c8c32727e894-kube-api-access-7c9rm\") pod \"maas-default-gateway-openshift-default-5896d4dd49-72bf4\" (UID: \"2e5743d8-6fd2-4656-9b9a-c8c32727e894\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.857856 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.857829    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:44.930940 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:44.930910    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:45.010413 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.010385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"]
Jul 07 18:52:45.011770 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:52:45.011742    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e5743d8_6fd2_4656_9b9a_c8c32727e894.slice/crio-6c21b749fa3d4f9160420b0ea84a166e540eea426beefb30a6053f4a342d8965 WatchSource:0}: Error finding container 6c21b749fa3d4f9160420b0ea84a166e540eea426beefb30a6053f4a342d8965: Status 404 returned error can't find the container with id 6c21b749fa3d4f9160420b0ea84a166e540eea426beefb30a6053f4a342d8965
Jul 07 18:52:45.013706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.013674    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:52:45.013785 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.013739    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:52:45.013785 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.013766    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:52:45.329286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.329196    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" event={"ID":"2e5743d8-6fd2-4656-9b9a-c8c32727e894","Type":"ContainerStarted","Data":"ea19228aab8e28dd4e05f8d00169af4d63c909f94375bd70fdb7ea13e8ffdbe9"}
Jul 07 18:52:45.329286 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.329244    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" event={"ID":"2e5743d8-6fd2-4656-9b9a-c8c32727e894","Type":"ContainerStarted","Data":"6c21b749fa3d4f9160420b0ea84a166e540eea426beefb30a6053f4a342d8965"}
Jul 07 18:52:45.356055 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.356006    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" podStartSLOduration=1.355990928 podStartE2EDuration="1.355990928s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:52:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:52:45.354667521 +0000 UTC m=+495.770959507" watchObservedRunningTime="2026-07-07 18:52:45.355990928 +0000 UTC m=+495.772282901"
Jul 07 18:52:45.858264 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:45.858217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:46.863623 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:46.863586    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:47.339551 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:47.339522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:47.340402 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:47.340386    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:52:52.926809 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:52.926776    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:53.026517 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:53.026478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:55.410637 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:55.410597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:52:55.474514 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:52:55.474481    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:03.998768 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:03.998724    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:04.119611 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:04.119576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:04.219698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:04.219634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:04.969275 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:04.969241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:05.065470 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:05.065435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:23.537173 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:23.537131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:53:33.727713 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:53:33.727673    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:02.640634 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:02.640588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:02.727764 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:02.727726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:08.886921 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.886880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:08.924441 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.924408    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:08.928221 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.928205    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:08.931122 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.931100    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:54:08.931234 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.931214    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tspxj\""
Jul 07 18:54:08.931777 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.931764    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:54:08.951827 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:08.951802    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:09.010368 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.010331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:09.018500 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.018474    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.018617 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.018507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ms4cp\" (UniqueName: \"kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.119809 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.119777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.119962 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.119814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ms4cp\" (UniqueName: \"kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.119962 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:54:09.119923    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 07 18:54:09.120038 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:54:09.119989    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert podName:1453973d-e39c-4310-a2f3-900a7af841fb nodeName:}" failed. No retries permitted until 2026-07-07 18:54:09.619972128 +0000 UTC m=+580.036264079 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert") pod "maas-controller-547c9cc8bd-nft46" (UID: "1453973d-e39c-4310-a2f3-900a7af841fb") : secret "maas-controller-webhook-cert" not found
Jul 07 18:54:09.122860 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.122835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:09.138992 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.138920    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:54:09.141343 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.141320    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ms4cp\" (UniqueName: \"kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.142517 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.142502    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.155090 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.155060    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:54:09.220848 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.220811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7rm\" (UniqueName: \"kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.221036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.220986    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.302774 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.302742    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:09.321585 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.321554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.321751 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.321603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7rm\" (UniqueName: \"kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.323858 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.323833    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.332500 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.332481    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7rm\" (UniqueName: \"kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm\") pod \"maas-controller-69fc6dbcbd-kldp7\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") " pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.459994 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.459963    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:09.624497 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.624453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.626863 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.626836    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") pod \"maas-controller-547c9cc8bd-nft46\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") " pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.810626 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.810599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:54:09.812689 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:54:09.812667    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e53c3cc_436a_4ed0_8bc9_fa4f4e7cea92.slice/crio-e50fece705ea7ea8983ff39fe26b3bfd7ec043f4f174f9e3cc43acab1abcdb79 WatchSource:0}: Error finding container e50fece705ea7ea8983ff39fe26b3bfd7ec043f4f174f9e3cc43acab1abcdb79: Status 404 returned error can't find the container with id e50fece705ea7ea8983ff39fe26b3bfd7ec043f4f174f9e3cc43acab1abcdb79
Jul 07 18:54:09.838564 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.838536    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:09.980815 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:09.980787    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:09.982080 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:54:09.982055    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1453973d_e39c_4310_a2f3_900a7af841fb.slice/crio-6bb8dc6a150280c6c54dbe3b947175a69ac9ee4b820ab849bc752d5361ad4f8b WatchSource:0}: Error finding container 6bb8dc6a150280c6c54dbe3b947175a69ac9ee4b820ab849bc752d5361ad4f8b: Status 404 returned error can't find the container with id 6bb8dc6a150280c6c54dbe3b947175a69ac9ee4b820ab849bc752d5361ad4f8b
Jul 07 18:54:10.760483 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:10.760440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547c9cc8bd-nft46" event={"ID":"1453973d-e39c-4310-a2f3-900a7af841fb","Type":"ContainerStarted","Data":"6bb8dc6a150280c6c54dbe3b947175a69ac9ee4b820ab849bc752d5361ad4f8b"}
Jul 07 18:54:10.762454 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:10.762425    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" event={"ID":"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92","Type":"ContainerStarted","Data":"e50fece705ea7ea8983ff39fe26b3bfd7ec043f4f174f9e3cc43acab1abcdb79"}
Jul 07 18:54:12.201692 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.201566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:12.322120 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.322080    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:12.776555 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.776510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" event={"ID":"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92","Type":"ContainerStarted","Data":"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"}
Jul 07 18:54:12.776789 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.776687    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:12.778000 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.777976    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547c9cc8bd-nft46" event={"ID":"1453973d-e39c-4310-a2f3-900a7af841fb","Type":"ContainerStarted","Data":"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"}
Jul 07 18:54:12.778103 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.778023    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:12.822036 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.821988    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" podStartSLOduration=1.677727022 podStartE2EDuration="3.821972708s" totalImagesPullingTime="2.144245686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:12.819849922 +0000 UTC m=+583.236141894" watchObservedRunningTime="2026-07-07 18:54:12.821972708 +0000 UTC m=+583.238264680"
Jul 07 18:54:12.874926 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:12.874877    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-547c9cc8bd-nft46" podStartSLOduration=2.911538045 podStartE2EDuration="4.874861664s" totalImagesPullingTime="1.963323619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:12.872937104 +0000 UTC m=+583.289229079" watchObservedRunningTime="2026-07-07 18:54:12.874861664 +0000 UTC m=+583.291153637"
Jul 07 18:54:23.789279 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:23.789250    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:54:23.789712 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:23.789314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:23.864120 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:23.864090    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:23.864324 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:23.864272    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-547c9cc8bd-nft46" podUID="1453973d-e39c-4310-a2f3-900a7af841fb" containerName="manager" containerID="cri-o://9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21" gracePeriod=30
Jul 07 18:54:24.112206 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.112183    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:24.255331 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.255301    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") pod \"1453973d-e39c-4310-a2f3-900a7af841fb\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") "
Jul 07 18:54:24.255515 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.255401    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ms4cp\" (UniqueName: \"kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp\") pod \"1453973d-e39c-4310-a2f3-900a7af841fb\" (UID: \"1453973d-e39c-4310-a2f3-900a7af841fb\") "
Jul 07 18:54:24.257479 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.257450    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "1453973d-e39c-4310-a2f3-900a7af841fb" (UID: "1453973d-e39c-4310-a2f3-900a7af841fb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:54:24.257582 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.257492    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp" (OuterVolumeSpecName: "kube-api-access-ms4cp") pod "1453973d-e39c-4310-a2f3-900a7af841fb" (UID: "1453973d-e39c-4310-a2f3-900a7af841fb"). InnerVolumeSpecName "kube-api-access-ms4cp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:54:24.357032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.356945    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/1453973d-e39c-4310-a2f3-900a7af841fb-webhook-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:54:24.357032 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.356972    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ms4cp\" (UniqueName: \"kubernetes.io/projected/1453973d-e39c-4310-a2f3-900a7af841fb-kube-api-access-ms4cp\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:54:24.842824 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.842789    2578 generic.go:356] "Generic (PLEG): container finished" podID="1453973d-e39c-4310-a2f3-900a7af841fb" containerID="9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21" exitCode=0
Jul 07 18:54:24.843223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.842838    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-547c9cc8bd-nft46"
Jul 07 18:54:24.843223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.842875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547c9cc8bd-nft46" event={"ID":"1453973d-e39c-4310-a2f3-900a7af841fb","Type":"ContainerDied","Data":"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"}
Jul 07 18:54:24.843223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.842930    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-547c9cc8bd-nft46" event={"ID":"1453973d-e39c-4310-a2f3-900a7af841fb","Type":"ContainerDied","Data":"6bb8dc6a150280c6c54dbe3b947175a69ac9ee4b820ab849bc752d5361ad4f8b"}
Jul 07 18:54:24.843223 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.842954    2578 scope.go:117] "RemoveContainer" containerID="9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"
Jul 07 18:54:24.852283 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.852266    2578 scope.go:117] "RemoveContainer" containerID="9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"
Jul 07 18:54:24.852520 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:54:24.852499    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21\": container with ID starting with 9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21 not found: ID does not exist" containerID="9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"
Jul 07 18:54:24.852586 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.852533    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21"} err="failed to get container status \"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21\": rpc error: code = NotFound desc = could not find container \"9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21\": container with ID starting with 9bbbd1b280b770ce2feca8e20960fa74d2b50bd4a5a867199cbbb94f91011f21 not found: ID does not exist"
Jul 07 18:54:24.868062 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.868041    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:24.875796 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:24.875772    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-547c9cc8bd-nft46"]
Jul 07 18:54:26.073320 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:26.073284    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1453973d-e39c-4310-a2f3-900a7af841fb" path="/var/lib/kubelet/pods/1453973d-e39c-4310-a2f3-900a7af841fb/volumes"
Jul 07 18:54:39.928896 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:39.928859    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:40.013259 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:40.013224    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:44.530696 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:44.530633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:45.078597 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.078557    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:45.159763 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.159732    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-74fb8746bf-x2xdx"]
Jul 07 18:54:45.160114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.160100    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1453973d-e39c-4310-a2f3-900a7af841fb" containerName="manager"
Jul 07 18:54:45.160114 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.160115    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1453973d-e39c-4310-a2f3-900a7af841fb" containerName="manager"
Jul 07 18:54:45.160203 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.160185    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1453973d-e39c-4310-a2f3-900a7af841fb" containerName="manager"
Jul 07 18:54:45.163326 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.163310    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.167959 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.167938    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 18:54:45.181588 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.181557    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74fb8746bf-x2xdx"]
Jul 07 18:54:45.185212 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.185182    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:45.245109 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.245076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-maas-api-tls\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.245271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.245179    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw5c7\" (UniqueName: \"kubernetes.io/projected/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-kube-api-access-zw5c7\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.245271 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.245217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-openshift-service-ca\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.346551 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.346471    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw5c7\" (UniqueName: \"kubernetes.io/projected/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-kube-api-access-zw5c7\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.346551 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.346514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-openshift-service-ca\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.346784 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.346554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-maas-api-tls\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.347332 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.347311    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-openshift-service-ca\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.349084 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.349062    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-maas-api-tls\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.357263 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.357242    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw5c7\" (UniqueName: \"kubernetes.io/projected/c4d3e503-8f6f-4445-ac03-b4bd82cceaea-kube-api-access-zw5c7\") pod \"maas-api-74fb8746bf-x2xdx\" (UID: \"c4d3e503-8f6f-4445-ac03-b4bd82cceaea\") " pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.475082 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.475048    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:45.610858 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.610766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:45.624293 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.624256    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-74fb8746bf-x2xdx"]
Jul 07 18:54:45.625356 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:54:45.625329    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4d3e503_8f6f_4445_ac03_b4bd82cceaea.slice/crio-f9ca0cfa1cc1a8eef57cfd5baaead85f5dee251c1a98d2c3de5d930c432a7909 WatchSource:0}: Error finding container f9ca0cfa1cc1a8eef57cfd5baaead85f5dee251c1a98d2c3de5d930c432a7909: Status 404 returned error can't find the container with id f9ca0cfa1cc1a8eef57cfd5baaead85f5dee251c1a98d2c3de5d930c432a7909
Jul 07 18:54:45.627249 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.627228    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:54:45.711735 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.711703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:45.795110 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.795080    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qmwhh"]
Jul 07 18:54:45.801135 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.801116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.804697 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.804669    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jrnck\""
Jul 07 18:54:45.804807 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.804773    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 18:54:45.812002 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.811978    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qmwhh"]
Jul 07 18:54:45.851687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.851559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6addf0c-dfad-48e5-b702-b8977049f1d3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.851880 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.851703    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6b7k\" (UniqueName: \"kubernetes.io/projected/b6addf0c-dfad-48e5-b702-b8977049f1d3-kube-api-access-v6b7k\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.951539 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.951504    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74fb8746bf-x2xdx" event={"ID":"c4d3e503-8f6f-4445-ac03-b4bd82cceaea","Type":"ContainerStarted","Data":"f9ca0cfa1cc1a8eef57cfd5baaead85f5dee251c1a98d2c3de5d930c432a7909"}
Jul 07 18:54:45.952884 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.952861    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6addf0c-dfad-48e5-b702-b8977049f1d3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.952956 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.952914    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6b7k\" (UniqueName: \"kubernetes.io/projected/b6addf0c-dfad-48e5-b702-b8977049f1d3-kube-api-access-v6b7k\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.953605 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.953583    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/b6addf0c-dfad-48e5-b702-b8977049f1d3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:45.974932 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:45.974908    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6b7k\" (UniqueName: \"kubernetes.io/projected/b6addf0c-dfad-48e5-b702-b8977049f1d3-kube-api-access-v6b7k\") pod \"payload-pre-processing-7964457696-qmwhh\" (UID: \"b6addf0c-dfad-48e5-b702-b8977049f1d3\") " pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:46.112410 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:46.112370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:46.245294 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:46.245269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-qmwhh"]
Jul 07 18:54:46.246363 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:54:46.246337    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6addf0c_dfad_48e5_b702_b8977049f1d3.slice/crio-44dd5a66a0796a0abc4dc5b4003a69d78ed5c2f8b16d49046dd6b136d2c1326a WatchSource:0}: Error finding container 44dd5a66a0796a0abc4dc5b4003a69d78ed5c2f8b16d49046dd6b136d2c1326a: Status 404 returned error can't find the container with id 44dd5a66a0796a0abc4dc5b4003a69d78ed5c2f8b16d49046dd6b136d2c1326a
Jul 07 18:54:46.981633 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:46.981563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh" event={"ID":"b6addf0c-dfad-48e5-b702-b8977049f1d3","Type":"ContainerStarted","Data":"44dd5a66a0796a0abc4dc5b4003a69d78ed5c2f8b16d49046dd6b136d2c1326a"}
Jul 07 18:54:48.993280 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:48.993248    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh" event={"ID":"b6addf0c-dfad-48e5-b702-b8977049f1d3","Type":"ContainerStarted","Data":"7e481527f8335de8ced9ce55c34da7c69c14e650f45727d739195abf541a5013"}
Jul 07 18:54:48.993734 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:48.993352    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:54:49.002003 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:49.001970    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-74fb8746bf-x2xdx" event={"ID":"c4d3e503-8f6f-4445-ac03-b4bd82cceaea","Type":"ContainerStarted","Data":"b6e3da4bcb0e6b3d870e66c2585910092f235f4f261c3f085ac0b42ed14f84e2"}
Jul 07 18:54:49.002146 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:49.002080    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:49.014178 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:49.014137    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh" podStartSLOduration=2.239078727 podStartE2EDuration="4.014125086s" totalImagesPullingTime="1.775046359s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:49.012681495 +0000 UTC m=+619.428973469" watchObservedRunningTime="2026-07-07 18:54:49.014125086 +0000 UTC m=+619.430417059"
Jul 07 18:54:49.034241 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:49.034202    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-74fb8746bf-x2xdx" podStartSLOduration=1.640413659 podStartE2EDuration="4.03418598s" totalImagesPullingTime="2.393772321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:54:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:54:49.034115422 +0000 UTC m=+619.450407395" watchObservedRunningTime="2026-07-07 18:54:49.03418598 +0000 UTC m=+619.450477954"
Jul 07 18:54:54.030197 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.030164    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e5743d8-6fd2-4656-9b9a-c8c32727e894" containerID="ea19228aab8e28dd4e05f8d00169af4d63c909f94375bd70fdb7ea13e8ffdbe9" exitCode=0
Jul 07 18:54:54.030614 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.030204    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" event={"ID":"2e5743d8-6fd2-4656-9b9a-c8c32727e894","Type":"ContainerDied","Data":"ea19228aab8e28dd4e05f8d00169af4d63c909f94375bd70fdb7ea13e8ffdbe9"}
Jul 07 18:54:54.030614 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.030574    2578 scope.go:117] "RemoveContainer" containerID="ea19228aab8e28dd4e05f8d00169af4d63c909f94375bd70fdb7ea13e8ffdbe9"
Jul 07 18:54:54.031518 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.031490    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:54:54.031593 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.031576    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:54:54.031660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:54.031628    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 18:54:55.016344 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:55.016298    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-74fb8746bf-x2xdx"
Jul 07 18:54:55.036967 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:55.036934    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" event={"ID":"2e5743d8-6fd2-4656-9b9a-c8c32727e894","Type":"ContainerStarted","Data":"2d553135814ff43a9ad5203a787c3b5dc37d1ff4cb2996854712ecdccc0dc86b"}
Jul 07 18:54:55.859194 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:55.859153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:54:55.859410 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:55.859279    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-72bf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:54:55.859410 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:55.859334    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" podUID="2e5743d8-6fd2-4656-9b9a-c8c32727e894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 18:54:56.138727 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:56.138619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:56.232743 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:56.232712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:54:56.858498 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:56.858459    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-72bf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:54:56.858828 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:56.858793    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" podUID="2e5743d8-6fd2-4656-9b9a-c8c32727e894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 18:54:57.858664 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:57.858614    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-72bf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:54:57.859190 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:57.859163    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" podUID="2e5743d8-6fd2-4656-9b9a-c8c32727e894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 18:54:58.858845 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:58.858807    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-72bf4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused" start-of-body=
Jul 07 18:54:58.859424 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:58.859391    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4" podUID="2e5743d8-6fd2-4656-9b9a-c8c32727e894" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.41:15021/healthz/ready\": dial tcp 10.133.0.41:15021: connect: connection refused"
Jul 07 18:54:59.862710 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:59.862673    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:54:59.863149 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:59.862929    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:54:59.863706 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:54:59.863689    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-72bf4"
Jul 07 18:55:00.009180 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:00.009149    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-qmwhh"
Jul 07 18:55:01.777687 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:01.777634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:08.136364 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.136330    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"]
Jul 07 18:55:08.140088 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.140069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.143283 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.143261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pblp2\""
Jul 07 18:55:08.144188 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.144170    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 18:55:08.144261 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.144215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 18:55:08.144308 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.144263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 18:55:08.158059 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.158024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:08.158710 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.158687    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"]
Jul 07 18:55:08.201192 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201164    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.201322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201212    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.201322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201236    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.201322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.201322 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.201460 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.201350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44tls\" (UniqueName: \"kubernetes.io/projected/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-kube-api-access-44tls\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.301808 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.301773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.301808 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.301813    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.301841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44tls\" (UniqueName: \"kubernetes.io/projected/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-kube-api-access-44tls\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.301883    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302050 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.302031    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302208 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.302072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302256 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.302201    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302256 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.302236    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.302356 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.302339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.304146 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.304126    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.304446 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.304427    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.325007 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.324980    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44tls\" (UniqueName: \"kubernetes.io/projected/839ef62f-19dd-4d10-a1e1-5a10b007c5a9-kube-api-access-44tls\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc\" (UID: \"839ef62f-19dd-4d10-a1e1-5a10b007c5a9\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.451660 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.451603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:08.588384 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:08.588353    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"]
Jul 07 18:55:08.589770 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:55:08.589743    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod839ef62f_19dd_4d10_a1e1_5a10b007c5a9.slice/crio-4d66b3ff38a5c48c5ddd9d076d5d97c570ea5c28d77c6977f16cb2098be40473 WatchSource:0}: Error finding container 4d66b3ff38a5c48c5ddd9d076d5d97c570ea5c28d77c6977f16cb2098be40473: Status 404 returned error can't find the container with id 4d66b3ff38a5c48c5ddd9d076d5d97c570ea5c28d77c6977f16cb2098be40473
Jul 07 18:55:09.112600 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:09.112566    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc" event={"ID":"839ef62f-19dd-4d10-a1e1-5a10b007c5a9","Type":"ContainerStarted","Data":"4d66b3ff38a5c48c5ddd9d076d5d97c570ea5c28d77c6977f16cb2098be40473"}
Jul 07 18:55:10.120725 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:10.120615    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc" event={"ID":"839ef62f-19dd-4d10-a1e1-5a10b007c5a9","Type":"ContainerStarted","Data":"48c1cd207bb6e594925e2f89696604731ce56e2b4d12e3986d6133414ccabfcf"}
Jul 07 18:55:17.166880 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:17.166837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:18.452163 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:18.452122    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:18.452584 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:18.452189    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:18.465143 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:18.465118    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:18.487503 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:18.487459    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc" podStartSLOduration=9.374184375 podStartE2EDuration="10.48744442s" totalImagesPullingTime="1.113260045s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:10.152039836 +0000 UTC m=+640.568331810" watchObservedRunningTime="2026-07-07 18:55:18.48744442 +0000 UTC m=+648.903736392"
Jul 07 18:55:19.180685 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:19.180655    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc"
Jul 07 18:55:31.432585 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.432550    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"]
Jul 07 18:55:31.435710 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.435686    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.438946 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.438926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 18:55:31.446241 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.446218    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"]
Jul 07 18:55:31.462838 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.462809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:31.507474 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.507627 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507477    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.507627 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.507627 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.507627 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68079ad-c9be-4c67-8be6-e2549debcff0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.507627 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.507626    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mn2hj\" (UniqueName: \"kubernetes.io/projected/f68079ad-c9be-4c67-8be6-e2549debcff0-kube-api-access-mn2hj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.608817 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608781    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.608817 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68079ad-c9be-4c67-8be6-e2549debcff0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609060 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.608905    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mn2hj\" (UniqueName: \"kubernetes.io/projected/f68079ad-c9be-4c67-8be6-e2549debcff0-kube-api-access-mn2hj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609290 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.609223    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609290 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.609265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.609366 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.609313    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.611454 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.611425    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f68079ad-c9be-4c67-8be6-e2549debcff0-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.611563 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.611501    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f68079ad-c9be-4c67-8be6-e2549debcff0-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.619209 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.619186    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mn2hj\" (UniqueName: \"kubernetes.io/projected/f68079ad-c9be-4c67-8be6-e2549debcff0-kube-api-access-mn2hj\") pod \"e2e-trlp-test-simulated-kserve-598466548d-kf8v4\" (UID: \"f68079ad-c9be-4c67-8be6-e2549debcff0\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.746911 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.746828    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:31.895529 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:31.895498    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"]
Jul 07 18:55:31.896400 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:55:31.896378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68079ad_c9be_4c67_8be6_e2549debcff0.slice/crio-c082b356c43bfd8dd40d4e945e857bdd36f3749819c3736fdb95f72c6fa11026 WatchSource:0}: Error finding container c082b356c43bfd8dd40d4e945e857bdd36f3749819c3736fdb95f72c6fa11026: Status 404 returned error can't find the container with id c082b356c43bfd8dd40d4e945e857bdd36f3749819c3736fdb95f72c6fa11026
Jul 07 18:55:32.238798 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:32.238762    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4" event={"ID":"f68079ad-c9be-4c67-8be6-e2549debcff0","Type":"ContainerStarted","Data":"1d4f089104e84e51db053341ce92459969b4550b5135b49158b0435b651d781f"}
Jul 07 18:55:32.238938 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:32.238816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4" event={"ID":"f68079ad-c9be-4c67-8be6-e2549debcff0","Type":"ContainerStarted","Data":"c082b356c43bfd8dd40d4e945e857bdd36f3749819c3736fdb95f72c6fa11026"}
Jul 07 18:55:32.263446 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:32.263397    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4" podStartSLOduration=1.050534306 podStartE2EDuration="1.263381463s" totalImagesPullingTime="212.847157ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:55:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:55:32.262549983 +0000 UTC m=+662.678841987" watchObservedRunningTime="2026-07-07 18:55:32.263381463 +0000 UTC m=+662.679673436"
Jul 07 18:55:38.062450 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:38.062414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:55:41.747572 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:41.747532    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:41.748076 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:41.747661    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:41.760617 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:41.760594    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:55:42.304009 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:55:42.303980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-kf8v4"
Jul 07 18:56:00.742266 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:00.742220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:06.164596 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:06.164559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:27.099731 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:27.099696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:28.355052 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:28.355016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:29.292637 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:29.292519    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:29.356091 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:29.356056    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:47.090481 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:47.090447    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:53.986269 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:53.986228    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:54.082257 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:54.082216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:55.147464 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:55.147427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:56:55.249446 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:56:55.249414    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:06.241400 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.241319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:06.335151 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.335116    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:58:06.335331 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.335310    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" podUID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" containerName="manager" containerID="cri-o://e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828" gracePeriod=30
Jul 07 18:58:06.585649 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.585624    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:58:06.698040 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.698002    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd7rm\" (UniqueName: \"kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm\") pod \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") "
Jul 07 18:58:06.698246 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.698103    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert\") pod \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\" (UID: \"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92\") "
Jul 07 18:58:06.700092 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.700063    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm" (OuterVolumeSpecName: "kube-api-access-wd7rm") pod "9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" (UID: "9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92"). InnerVolumeSpecName "kube-api-access-wd7rm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:58:06.700265 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.700242    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" (UID: "9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:58:06.799561 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.799469    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd7rm\" (UniqueName: \"kubernetes.io/projected/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-kube-api-access-wd7rm\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:58:06.799561 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:06.799507    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92-webhook-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 18:58:07.067229 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.067141    2578 generic.go:356] "Generic (PLEG): container finished" podID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" containerID="e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828" exitCode=0
Jul 07 18:58:07.067229 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.067179    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7"
Jul 07 18:58:07.067417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.067228    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" event={"ID":"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92","Type":"ContainerDied","Data":"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"}
Jul 07 18:58:07.067417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.067270    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-kldp7" event={"ID":"9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92","Type":"ContainerDied","Data":"e50fece705ea7ea8983ff39fe26b3bfd7ec043f4f174f9e3cc43acab1abcdb79"}
Jul 07 18:58:07.067417 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.067291    2578 scope.go:117] "RemoveContainer" containerID="e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"
Jul 07 18:58:07.076557 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.076539    2578 scope.go:117] "RemoveContainer" containerID="e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"
Jul 07 18:58:07.076802 ip-10-0-141-88 kubenswrapper[2578]: E0707 18:58:07.076786    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828\": container with ID starting with e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828 not found: ID does not exist" containerID="e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"
Jul 07 18:58:07.076857 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.076808    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828"} err="failed to get container status \"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828\": rpc error: code = NotFound desc = could not find container \"e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828\": container with ID starting with e89a82f75d256105e49c8a90e28ef9c5d61269d551ca8d5ebef488dbe69dc828 not found: ID does not exist"
Jul 07 18:58:07.096332 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.096311    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:58:07.098568 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.098550    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-kldp7"]
Jul 07 18:58:07.775519 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.775485    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:07.884134 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.884102    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-5294q"]
Jul 07 18:58:07.884698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.884673    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" containerName="manager"
Jul 07 18:58:07.884698 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.884696    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" containerName="manager"
Jul 07 18:58:07.884887 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.884772    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" containerName="manager"
Jul 07 18:58:07.888921 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.888905    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:07.892872 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.892855    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 18:58:07.893014 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.892988    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tspxj\""
Jul 07 18:58:07.893131 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.892996    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 18:58:07.899443 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:07.899422    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-5294q"]
Jul 07 18:58:08.012498 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.012465    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-webhook-cert\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.012723 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.012544    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbnrs\" (UniqueName: \"kubernetes.io/projected/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-kube-api-access-kbnrs\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.072343 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.072254    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92" path="/var/lib/kubelet/pods/9e53c3cc-436a-4ed0-8bc9-fa4f4e7cea92/volumes"
Jul 07 18:58:08.113258 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.113225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbnrs\" (UniqueName: \"kubernetes.io/projected/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-kube-api-access-kbnrs\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.113439 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.113339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-webhook-cert\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.115825 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.115794    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-webhook-cert\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.124214 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.124189    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbnrs\" (UniqueName: \"kubernetes.io/projected/0ffaf4e4-a3d2-48a5-825d-d005c1410d2a-kube-api-access-kbnrs\") pod \"maas-controller-69fc6dbcbd-5294q\" (UID: \"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a\") " pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.200085 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.200057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:08.335464 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:08.335429    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-69fc6dbcbd-5294q"]
Jul 07 18:58:08.336901 ip-10-0-141-88 kubenswrapper[2578]: W0707 18:58:08.336875    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ffaf4e4_a3d2_48a5_825d_d005c1410d2a.slice/crio-cd914e1e4fab5679208483253dca8f80ad9ea345eb215fb5e602bbed66f95fc3 WatchSource:0}: Error finding container cd914e1e4fab5679208483253dca8f80ad9ea345eb215fb5e602bbed66f95fc3: Status 404 returned error can't find the container with id cd914e1e4fab5679208483253dca8f80ad9ea345eb215fb5e602bbed66f95fc3
Jul 07 18:58:09.080418 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:09.080384    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-5294q" event={"ID":"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a","Type":"ContainerStarted","Data":"b07d7ca6d5e633042730815b9a1c98b391f6c49dc2e1a7f37350d3dee2d1edb3"}
Jul 07 18:58:09.080804 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:09.080432    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-69fc6dbcbd-5294q" event={"ID":"0ffaf4e4-a3d2-48a5-825d-d005c1410d2a","Type":"ContainerStarted","Data":"cd914e1e4fab5679208483253dca8f80ad9ea345eb215fb5e602bbed66f95fc3"}
Jul 07 18:58:09.080804 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:09.080504    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:09.101702 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:09.101632    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-69fc6dbcbd-5294q" podStartSLOduration=1.582683561 podStartE2EDuration="2.101619381s" totalImagesPullingTime="518.93582ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:58:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:58:09.100415911 +0000 UTC m=+819.516707884" watchObservedRunningTime="2026-07-07 18:58:09.101619381 +0000 UTC m=+819.517911353"
Jul 07 18:58:20.092384 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:20.092354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-69fc6dbcbd-5294q"
Jul 07 18:58:41.897099 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:41.897064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:48.676386 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:48.676322    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:48.790962 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:48.790921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:48.921448 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:48.921417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.445345 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:55.445301    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.563606 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:55.563575    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.642260 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:55.642225    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:58:55.808949 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:58:55.808863    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:01.850897 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:59:01.850861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:01.949379 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:59:01.949349    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 18:59:20.444469 ip-10-0-141-88 kubenswrapper[2578]: I0707 18:59:20.444434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:52.822850 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:01:52.822815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:01:54.342891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:01:54.342861    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:25.716193 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:02:25.716155    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:02:51.988276 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:02:51.988241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:07:30.042046 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:07:30.042014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:08:06.038170 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:08:06.038135    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:08:13.955873 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:08:13.955838    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:09:40.010045 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:09:40.009991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:09:47.849042 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:09:47.849004    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:09:56.058669 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:09:56.058553    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:01.246403 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:01.246367    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:04.133129 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:04.133077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:04.231438 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:04.231400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:04.885679 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:04.885629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:12.170291 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.170250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:12.261885 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.261833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:12.380684 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.378664    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:12.386191 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.386162    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.389428 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.389406    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-699b72f9-openshift-default-dockercfg-5w2q7\""
Jul 07 19:10:12.402500 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.402477    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:12.408325 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.408290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:12.473125 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473125 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473081    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473125 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473478 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473150    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473478 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473170    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473478 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473478 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473478 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473382    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5l9w\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.473909 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.473882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.487540 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.487488    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:12.574956 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.574910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.574980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575130    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5l9w\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575446 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575446 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575446 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575287    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575446 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575397    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575680 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575635    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.575897 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.576013 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.575985    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.576082 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.576064    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.577889 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.577867    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.578040 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.578022    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.591774 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.591749    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.592002 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.591983    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5l9w\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w\") pod \"e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") " pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.696815 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.696782    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:12.846400 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.846368    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:12.848208 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:12.848180    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd30c424_62c3_4b21_b46e_99c911f14d52.slice/crio-f12b2393aa0344e4579ae54a0f1163bc10ef24a829d1ee5cd0020fbdb4d9de59 WatchSource:0}: Error finding container f12b2393aa0344e4579ae54a0f1163bc10ef24a829d1ee5cd0020fbdb4d9de59: Status 404 returned error can't find the container with id f12b2393aa0344e4579ae54a0f1163bc10ef24a829d1ee5cd0020fbdb4d9de59
Jul 07 19:10:12.850289 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.850258    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:12.850366 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.850353    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:12.850403 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.850391    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:12.921795 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.921760    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" event={"ID":"fd30c424-62c3-4b21-b46e-99c911f14d52","Type":"ContainerStarted","Data":"6569b61b4a6cc678061ce9dd82a5eda9348e4d31f1aed467a8c6ef9f2f79c835"}
Jul 07 19:10:12.921932 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.921819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" event={"ID":"fd30c424-62c3-4b21-b46e-99c911f14d52","Type":"ContainerStarted","Data":"f12b2393aa0344e4579ae54a0f1163bc10ef24a829d1ee5cd0020fbdb4d9de59"}
Jul 07 19:10:12.947945 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:12.947881    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" podStartSLOduration=0.94786377 podStartE2EDuration="947.86377ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:12.945258724 +0000 UTC m=+1543.361550699" watchObservedRunningTime="2026-07-07 19:10:12.94786377 +0000 UTC m=+1543.364155742"
Jul 07 19:10:13.587611 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.587584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:13.683181 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.683144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:13.697275 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.697248    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:13.702005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.701980    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:13.822220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.822176    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:13.826571 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.826549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:13.829249 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.829224    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-699b72f9-serving-cert\""
Jul 07 19:10:13.829377 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.829318    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:10:13.836672 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.836625    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:13.880447 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.880363    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:13.928169 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.928139    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:13.929156 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.929131    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:13.989310 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.989271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:13.989501 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.989434    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5tlr\" (UniqueName: \"kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:13.989501 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:13.989485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.091049 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.091013    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.091227 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.091099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5tlr\" (UniqueName: \"kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.091227 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.091134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.091360 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:14.091248    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-699b72f9-serving-cert: secret "maas-api-e2e-ait-699b72f9-serving-cert" not found
Jul 07 19:10:14.091360 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:14.091340    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls podName:bdc330ad-fb2b-4d38-a008-ea3bcfb41da0 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:14.591315771 +0000 UTC m=+1545.007607736 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls") pod "maas-api-e2e-ait-699b72f9-8489956bfd-56b87" (UID: "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0") : secret "maas-api-e2e-ait-699b72f9-serving-cert" not found
Jul 07 19:10:14.091752 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.091735    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.101138 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.101113    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5tlr\" (UniqueName: \"kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.545915 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.545885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:14.597075 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.597037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:14.597451 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:14.597165    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-699b72f9-serving-cert: secret "maas-api-e2e-ait-699b72f9-serving-cert" not found
Jul 07 19:10:14.597451 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:14.597227    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls podName:bdc330ad-fb2b-4d38-a008-ea3bcfb41da0 nodeName:}" failed. No retries permitted until 2026-07-07 19:10:15.597209771 +0000 UTC m=+1546.013501721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls") pod "maas-api-e2e-ait-699b72f9-8489956bfd-56b87" (UID: "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0") : secret "maas-api-e2e-ait-699b72f9-serving-cert" not found
Jul 07 19:10:14.664756 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.664722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:14.752231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:14.752202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:15.607990 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.607952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:15.610404 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.610385    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"maas-api-e2e-ait-699b72f9-8489956bfd-56b87\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") " pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:15.639436 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.639407    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:15.786597 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.786567    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:15.788195 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:15.788167    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdc330ad_fb2b_4d38_a008_ea3bcfb41da0.slice/crio-264dfdf9855e92ab11c914e5653954c0b15e4446189c366a711bf06b0d650bd0 WatchSource:0}: Error finding container 264dfdf9855e92ab11c914e5653954c0b15e4446189c366a711bf06b0d650bd0: Status 404 returned error can't find the container with id 264dfdf9855e92ab11c914e5653954c0b15e4446189c366a711bf06b0d650bd0
Jul 07 19:10:15.789903 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.789881    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:10:15.947581 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:15.947540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" event={"ID":"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0","Type":"ContainerStarted","Data":"264dfdf9855e92ab11c914e5653954c0b15e4446189c366a711bf06b0d650bd0"}
Jul 07 19:10:16.458410 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:16.458370    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:16.955586 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:16.955551    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" event={"ID":"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0","Type":"ContainerStarted","Data":"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"}
Jul 07 19:10:16.956053 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:16.955682    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:16.988297 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:16.988246    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" podStartSLOduration=3.5028725290000002 podStartE2EDuration="3.988229702s" totalImagesPullingTime="485.357173ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:16.985939773 +0000 UTC m=+1547.402231746" watchObservedRunningTime="2026-07-07 19:10:16.988229702 +0000 UTC m=+1547.404521675"
Jul 07 19:10:18.623097 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:18.623064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:18.798140 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:18.798106    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:18.798325 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:18.798303    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" podUID="fd30c424-62c3-4b21-b46e-99c911f14d52" containerName="istio-proxy" containerID="cri-o://6569b61b4a6cc678061ce9dd82a5eda9348e4d31f1aed467a8c6ef9f2f79c835" gracePeriod=30
Jul 07 19:10:18.828967 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:18.828930    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:18.955023 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:18.954991    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:19.133385 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.133323    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:19.133749 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.133694    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" podUID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" containerName="maas-api" containerID="cri-o://bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89" gracePeriod=30
Jul 07 19:10:19.154234 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.154208    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:19.386233 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.386209    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:19.544721 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.544603    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") pod \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") "
Jul 07 19:10:19.544867 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.544735    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5tlr\" (UniqueName: \"kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr\") pod \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") "
Jul 07 19:10:19.544867 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.544816    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca\") pod \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\" (UID: \"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0\") "
Jul 07 19:10:19.545152 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.545126    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" (UID: "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:19.546683 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.546654    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" (UID: "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:10:19.546789 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.546691    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr" (OuterVolumeSpecName: "kube-api-access-l5tlr") pod "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" (UID: "bdc330ad-fb2b-4d38-a008-ea3bcfb41da0"). InnerVolumeSpecName "kube-api-access-l5tlr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:19.646827 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.646784    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:19.646827 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.646819    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5tlr\" (UniqueName: \"kubernetes.io/projected/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-kube-api-access-l5tlr\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:19.646827 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.646835    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:19.973109 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.973076    2578 generic.go:356] "Generic (PLEG): container finished" podID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" containerID="bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89" exitCode=0
Jul 07 19:10:19.973285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.973124    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"
Jul 07 19:10:19.973285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.973149    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" event={"ID":"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0","Type":"ContainerDied","Data":"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"}
Jul 07 19:10:19.973285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.973189    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87" event={"ID":"bdc330ad-fb2b-4d38-a008-ea3bcfb41da0","Type":"ContainerDied","Data":"264dfdf9855e92ab11c914e5653954c0b15e4446189c366a711bf06b0d650bd0"}
Jul 07 19:10:19.973285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.973209    2578 scope.go:117] "RemoveContainer" containerID="bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"
Jul 07 19:10:19.983077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.983059    2578 scope.go:117] "RemoveContainer" containerID="bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"
Jul 07 19:10:19.983340 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:19.983323    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89\": container with ID starting with bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89 not found: ID does not exist" containerID="bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"
Jul 07 19:10:19.983398 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:19.983350    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89"} err="failed to get container status \"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89\": rpc error: code = NotFound desc = could not find container \"bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89\": container with ID starting with bbb3799a601ede5f194fa7400fbef6287b5357bfb80b1b5f02c3069160fc2b89 not found: ID does not exist"
Jul 07 19:10:20.001341 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:20.001318    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:20.006232 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:20.006209    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-699b72f9-8489956bfd-56b87"]
Jul 07 19:10:20.076522 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:20.076487    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" path="/var/lib/kubelet/pods/bdc330ad-fb2b-4d38-a008-ea3bcfb41da0/volumes"
Jul 07 19:10:22.869198 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:22.869156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:23.998493 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:23.998457    2578 generic.go:356] "Generic (PLEG): container finished" podID="fd30c424-62c3-4b21-b46e-99c911f14d52" containerID="6569b61b4a6cc678061ce9dd82a5eda9348e4d31f1aed467a8c6ef9f2f79c835" exitCode=0
Jul 07 19:10:23.998871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:23.998528    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" event={"ID":"fd30c424-62c3-4b21-b46e-99c911f14d52","Type":"ContainerDied","Data":"6569b61b4a6cc678061ce9dd82a5eda9348e4d31f1aed467a8c6ef9f2f79c835"}
Jul 07 19:10:24.058631 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.058571    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:24.187997 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.187946    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188188 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188049    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188188 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188071    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188284 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188199    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5l9w\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188284 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188241    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188284 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188273    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:24.188452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188290    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188363    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data" (OuterVolumeSpecName: "istio-data") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:24.188452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188375    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188426    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket\") pod \"fd30c424-62c3-4b21-b46e-99c911f14d52\" (UID: \"fd30c424-62c3-4b21-b46e-99c911f14d52\") "
Jul 07 19:10:24.188790 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188509    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:24.188790 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188592    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:24.188899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188824    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:24.188999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188968    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.188999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.188988    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.189110 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.189002    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fd30c424-62c3-4b21-b46e-99c911f14d52-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.189110 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.189015    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.189110 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.189028    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.190397 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.190365    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token" (OuterVolumeSpecName: "istio-token") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:24.190498 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.190466    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w" (OuterVolumeSpecName: "kube-api-access-c5l9w") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "kube-api-access-c5l9w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:24.190812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.190794    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:24.190862 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.190798    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fd30c424-62c3-4b21-b46e-99c911f14d52" (UID: "fd30c424-62c3-4b21-b46e-99c911f14d52"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:10:24.289767 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.289733    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.289767 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.289760    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5l9w\" (UniqueName: \"kubernetes.io/projected/fd30c424-62c3-4b21-b46e-99c911f14d52-kube-api-access-c5l9w\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.289767 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.289770    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:24.289767 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:24.289780    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fd30c424-62c3-4b21-b46e-99c911f14d52-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:25.005120 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.005090    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"
Jul 07 19:10:25.005542 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.005133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf" event={"ID":"fd30c424-62c3-4b21-b46e-99c911f14d52","Type":"ContainerDied","Data":"f12b2393aa0344e4579ae54a0f1163bc10ef24a829d1ee5cd0020fbdb4d9de59"}
Jul 07 19:10:25.005542 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.005196    2578 scope.go:117] "RemoveContainer" containerID="6569b61b4a6cc678061ce9dd82a5eda9348e4d31f1aed467a8c6ef9f2f79c835"
Jul 07 19:10:25.031605 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.031571    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:25.035205 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.035182    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-699b72f9-openshift-default-75f844d4f5-2ghzf"]
Jul 07 19:10:25.364321 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.364246    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:25.464596 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.464559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:25.550857 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.550818    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:25.551293 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551276    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" containerName="maas-api"
Jul 07 19:10:25.551377 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551294    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" containerName="maas-api"
Jul 07 19:10:25.551377 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551318    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd30c424-62c3-4b21-b46e-99c911f14d52" containerName="istio-proxy"
Jul 07 19:10:25.551377 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551324    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd30c424-62c3-4b21-b46e-99c911f14d52" containerName="istio-proxy"
Jul 07 19:10:25.551530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551383    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd30c424-62c3-4b21-b46e-99c911f14d52" containerName="istio-proxy"
Jul 07 19:10:25.551530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.551393    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdc330ad-fb2b-4d38-a008-ea3bcfb41da0" containerName="maas-api"
Jul 07 19:10:25.555986 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.555962    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.559069 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.559043    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-8873c1f7-openshift-default-dockercfg-hdmw5\""
Jul 07 19:10:25.572981 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.572960    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:25.596208 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.596180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:25.599619 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599748 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599623    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599748 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599668    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599748 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599702    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599865 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599772    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599865 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599803    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599865 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599822    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599972 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599906    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.599972 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.599934    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zm8\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.661193 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.661161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:25.700375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700349    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700380    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700401    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700456    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zm8\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700532    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700949 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700949 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700819    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.700949 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.701087 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.700998    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.701087 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.701048    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.701318 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.701302    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.702829 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.702806    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.703034 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.703017    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.712101 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.712081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.712914 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.712897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zm8\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8\") pod \"e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") " pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:25.867617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:25.867580    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:26.015517 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.015489    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:26.017146 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:26.017120    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3e3eeee_bbd8_4d7c_9fc0_e722220ca6b0.slice/crio-429efd706fd6e657d928561470286b0cdd81872f74af1285c917f22c71075c8c WatchSource:0}: Error finding container 429efd706fd6e657d928561470286b0cdd81872f74af1285c917f22c71075c8c: Status 404 returned error can't find the container with id 429efd706fd6e657d928561470286b0cdd81872f74af1285c917f22c71075c8c
Jul 07 19:10:26.019130 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.019093    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:26.019198 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.019163    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:26.019198 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.019190    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:26.071081 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.071054    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd30c424-62c3-4b21-b46e-99c911f14d52" path="/var/lib/kubelet/pods/fd30c424-62c3-4b21-b46e-99c911f14d52/volumes"
Jul 07 19:10:26.733989 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.733959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:26.845019 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.844974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:26.867077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.867047    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:26.870754 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.870728    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:26.876843 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.876819    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:10:26.876982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.876969    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-8873c1f7-serving-cert\""
Jul 07 19:10:26.885929 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.885905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:26.911515 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.911482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmdnj\" (UniqueName: \"kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:26.911702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.911537    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:26.911702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.911689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:26.936867 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:26.936833    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:27.013206 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.013121    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.013206 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.013167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmdnj\" (UniqueName: \"kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.013397 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.013217    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.013397 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:27.013355    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-ait-8873c1f7-serving-cert: secret "maas-api-e2e-ait-8873c1f7-serving-cert" not found
Jul 07 19:10:27.013482 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:27.013416    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls podName:7da29f69-4e1d-4ff4-b166-b848da6804af nodeName:}" failed. No retries permitted until 2026-07-07 19:10:27.513397576 +0000 UTC m=+1557.929689542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls") pod "maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" (UID: "7da29f69-4e1d-4ff4-b166-b848da6804af") : secret "maas-api-e2e-ait-8873c1f7-serving-cert" not found
Jul 07 19:10:27.013801 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.013782    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.019088 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.019060    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerStarted","Data":"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"}
Jul 07 19:10:27.019422 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.019116    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerStarted","Data":"429efd706fd6e657d928561470286b0cdd81872f74af1285c917f22c71075c8c"}
Jul 07 19:10:27.026097 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.026074    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmdnj\" (UniqueName: \"kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.053288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.053241    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" podStartSLOduration=2.053225171 podStartE2EDuration="2.053225171s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:27.052066426 +0000 UTC m=+1557.468358410" watchObservedRunningTime="2026-07-07 19:10:27.053225171 +0000 UTC m=+1557.469517135"
Jul 07 19:10:27.094582 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.094550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:27.404576 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.404546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:27.503723 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.503676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:27.519437 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.519407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.521850 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.521830    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") pod \"maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") " pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.782396 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.782300    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:27.868216 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.868187    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:27.873514 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.873484    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:27.924095 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:27.924066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:27.925615 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:27.925591    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7da29f69_4e1d_4ff4_b166_b848da6804af.slice/crio-a566a3e16bc68be6d999dd320686cbe9b18424a3f204e5eb30f04a5c7e1218b8 WatchSource:0}: Error finding container a566a3e16bc68be6d999dd320686cbe9b18424a3f204e5eb30f04a5c7e1218b8: Status 404 returned error can't find the container with id a566a3e16bc68be6d999dd320686cbe9b18424a3f204e5eb30f04a5c7e1218b8
Jul 07 19:10:28.026375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:28.026333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" event={"ID":"7da29f69-4e1d-4ff4-b166-b848da6804af","Type":"ContainerStarted","Data":"a566a3e16bc68be6d999dd320686cbe9b18424a3f204e5eb30f04a5c7e1218b8"}
Jul 07 19:10:28.026772 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:28.026584    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:28.027538 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:28.027519    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:28.650610 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:28.650581    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:29.033225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:29.033193    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" event={"ID":"7da29f69-4e1d-4ff4-b166-b848da6804af","Type":"ContainerStarted","Data":"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"}
Jul 07 19:10:29.033710 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:29.033404    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:29.061954 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:29.061904    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" podStartSLOduration=2.758588193 podStartE2EDuration="3.061889885s" totalImagesPullingTime="303.301692ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:29.059802799 +0000 UTC m=+1559.476094772" watchObservedRunningTime="2026-07-07 19:10:29.061889885 +0000 UTC m=+1559.478181857"
Jul 07 19:10:31.880585 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:31.880549    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:32.280670 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.279801    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:32.280670 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.280033    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" podUID="7da29f69-4e1d-4ff4-b166-b848da6804af" containerName="maas-api" containerID="cri-o://a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6" gracePeriod=30
Jul 07 19:10:32.288046 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.288014    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:32.545285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.545256    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:32.584667 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.584212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mmdnj\" (UniqueName: \"kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj\") pod \"7da29f69-4e1d-4ff4-b166-b848da6804af\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") "
Jul 07 19:10:32.584667 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.584321    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca\") pod \"7da29f69-4e1d-4ff4-b166-b848da6804af\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") "
Jul 07 19:10:32.584667 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.584373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") pod \"7da29f69-4e1d-4ff4-b166-b848da6804af\" (UID: \"7da29f69-4e1d-4ff4-b166-b848da6804af\") "
Jul 07 19:10:32.585048 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.585008    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7da29f69-4e1d-4ff4-b166-b848da6804af" (UID: "7da29f69-4e1d-4ff4-b166-b848da6804af"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:32.587147 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.587121    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj" (OuterVolumeSpecName: "kube-api-access-mmdnj") pod "7da29f69-4e1d-4ff4-b166-b848da6804af" (UID: "7da29f69-4e1d-4ff4-b166-b848da6804af"). InnerVolumeSpecName "kube-api-access-mmdnj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:32.587388 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.587362    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7da29f69-4e1d-4ff4-b166-b848da6804af" (UID: "7da29f69-4e1d-4ff4-b166-b848da6804af"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:10:32.685519 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.685478    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7da29f69-4e1d-4ff4-b166-b848da6804af-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:32.685519 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.685513    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mmdnj\" (UniqueName: \"kubernetes.io/projected/7da29f69-4e1d-4ff4-b166-b848da6804af-kube-api-access-mmdnj\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:32.685519 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:32.685527    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7da29f69-4e1d-4ff4-b166-b848da6804af-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:33.059999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.059957    2578 generic.go:356] "Generic (PLEG): container finished" podID="7da29f69-4e1d-4ff4-b166-b848da6804af" containerID="a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6" exitCode=0
Jul 07 19:10:33.060536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.060065    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" event={"ID":"7da29f69-4e1d-4ff4-b166-b848da6804af","Type":"ContainerDied","Data":"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"}
Jul 07 19:10:33.060536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.060186    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq" event={"ID":"7da29f69-4e1d-4ff4-b166-b848da6804af","Type":"ContainerDied","Data":"a566a3e16bc68be6d999dd320686cbe9b18424a3f204e5eb30f04a5c7e1218b8"}
Jul 07 19:10:33.060536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.060223    2578 scope.go:117] "RemoveContainer" containerID="a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"
Jul 07 19:10:33.060536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.060429    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"
Jul 07 19:10:33.075477 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.075450    2578 scope.go:117] "RemoveContainer" containerID="a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"
Jul 07 19:10:33.075870 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:33.075840    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6\": container with ID starting with a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6 not found: ID does not exist" containerID="a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"
Jul 07 19:10:33.075972 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.075882    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6"} err="failed to get container status \"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6\": rpc error: code = NotFound desc = could not find container \"a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6\": container with ID starting with a0bf2c4e9f9255cbb0f3b2c3bb2eeaf1f6823ce99da8ed3655c48fce1662bbe6 not found: ID does not exist"
Jul 07 19:10:33.097433 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.097406    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:33.099939 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:33.099914    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-8873c1f7-7fd9c4bb67-rrwxq"]
Jul 07 19:10:34.079204 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:34.079160    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7da29f69-4e1d-4ff4-b166-b848da6804af" path="/var/lib/kubelet/pods/7da29f69-4e1d-4ff4-b166-b848da6804af/volumes"
Jul 07 19:10:37.099245 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.099221    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerID="513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b" exitCode=0
Jul 07 19:10:37.099661 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.099293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerDied","Data":"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"}
Jul 07 19:10:37.099816 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.099799    2578 scope.go:117] "RemoveContainer" containerID="513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"
Jul 07 19:10:37.100836 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.100812    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:37.100904 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.100875    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:37.100943 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.100905    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:37.927355 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.927319    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:37.954509 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:37.954478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:38.055530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:38.055500    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:38.105984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:38.105949    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerStarted","Data":"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"}
Jul 07 19:10:38.106374 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:38.106014    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy" containerID="cri-o://6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1" gracePeriod=30
Jul 07 19:10:41.549574 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:41.549541    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:43.027500 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.027465    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:43.374525 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.374498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:43.489594 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489564    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489594 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8zm8\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489699    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489739    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489756    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489803    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.489853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489827    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.490165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.489869    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs\") pod \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\" (UID: \"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0\") "
Jul 07 19:10:43.490165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.490052    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:43.490280 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.490239    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.490662 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.490609    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:43.490819 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.490712    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:43.491037 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.491009    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:43.491132 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.491091    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:43.492021 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.491993    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:43.492135 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.492022    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:10:43.492188 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.492171    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8" (OuterVolumeSpecName: "kube-api-access-v8zm8") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "kube-api-access-v8zm8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:43.492226 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.492187    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" (UID: "c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.590965    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8zm8\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-kube-api-access-v8zm8\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.590994    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591003    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591012    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591021    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591029    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591037    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:43.591066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:43.591046    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:44.141591 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.141553    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerID="6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1" exitCode=0
Jul 07 19:10:44.141999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.141608    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"
Jul 07 19:10:44.141999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.141614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerDied","Data":"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"}
Jul 07 19:10:44.141999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.141684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv" event={"ID":"c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0","Type":"ContainerDied","Data":"429efd706fd6e657d928561470286b0cdd81872f74af1285c917f22c71075c8c"}
Jul 07 19:10:44.141999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.141714    2578 scope.go:117] "RemoveContainer" containerID="6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"
Jul 07 19:10:44.150604 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.150584    2578 scope.go:117] "RemoveContainer" containerID="513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"
Jul 07 19:10:44.158385 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.158369    2578 scope.go:117] "RemoveContainer" containerID="6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"
Jul 07 19:10:44.158620 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:44.158601    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1\": container with ID starting with 6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1 not found: ID does not exist" containerID="6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"
Jul 07 19:10:44.158714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.158633    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1"} err="failed to get container status \"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1\": rpc error: code = NotFound desc = could not find container \"6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1\": container with ID starting with 6cf5507909fafb58344cb3ec7539b1892158faa1c3fed027a7f332d9478556c1 not found: ID does not exist"
Jul 07 19:10:44.158714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.158671    2578 scope.go:117] "RemoveContainer" containerID="513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"
Jul 07 19:10:44.158913 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:44.158896    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b\": container with ID starting with 513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b not found: ID does not exist" containerID="513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"
Jul 07 19:10:44.158952 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.158919    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b"} err="failed to get container status \"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b\": rpc error: code = NotFound desc = could not find container \"513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b\": container with ID starting with 513795b1fed404ed14861e84a51cd76ab089bccf37218d19aab44a9c56d5ba5b not found: ID does not exist"
Jul 07 19:10:44.164397 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.164375    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:44.168570 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.168550    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-8873c1f7-openshift-default-5ff5cf557c-jsghv"]
Jul 07 19:10:44.511199 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.511170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:44.612197 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.612161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:44.703148 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703113    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:44.703653 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703627    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:44.703719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703661    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:44.703719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703678    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:44.703719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703684    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:44.703719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703700    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7da29f69-4e1d-4ff4-b166-b848da6804af" containerName="maas-api"
Jul 07 19:10:44.703719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703705    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="7da29f69-4e1d-4ff4-b166-b848da6804af" containerName="maas-api"
Jul 07 19:10:44.703899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703768    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="7da29f69-4e1d-4ff4-b166-b848da6804af" containerName="maas-api"
Jul 07 19:10:44.703899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.703776    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:44.706911 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.706889    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.709903 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.709880    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-0c711be3-openshift-default-dockercfg-72xlv\""
Jul 07 19:10:44.727938 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.727911    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:44.730484 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.730459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:44.795310 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.795232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:44.800669 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800837 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800837 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800837 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800837 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800821    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800994 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800896    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.800994 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.800929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.801084 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.801003    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.801084 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.801035    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlql6\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901615 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901577    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901680    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901730    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlql6\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901755    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.901812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901812    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901839    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.901887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.902058    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.902066    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902347 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.902181    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902347 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.902238    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.902592 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.902569    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.904061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.904038    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.904261 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.904246    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.915080 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.915055    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:44.915880 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:44.915861    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlql6\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6\") pod \"e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") " pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:45.018500 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.018471    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:45.165333 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.165283    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:45.168719 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:45.168684    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ed4e7f2_acc0_4e1a_862b_8a4f70cf94d9.slice/crio-720c1c382cdda4805a2ca2df046c3b75bd0630eeace1d702956f888c1fbc3f45 WatchSource:0}: Error finding container 720c1c382cdda4805a2ca2df046c3b75bd0630eeace1d702956f888c1fbc3f45: Status 404 returned error can't find the container with id 720c1c382cdda4805a2ca2df046c3b75bd0630eeace1d702956f888c1fbc3f45
Jul 07 19:10:45.171012 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.170984    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:45.171076 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.171047    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:45.171116 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.171077    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:10:45.822453 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.822416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:45.902082 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.902037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:45.903710 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.903670    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:45.904166 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.904148    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" containerName="istio-proxy"
Jul 07 19:10:45.906408 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.906392    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:45.909215 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.909195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-0c711be3-serving-cert\""
Jul 07 19:10:45.909302 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.909204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:10:45.919467 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.919442    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:45.973027 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:45.972994    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:46.013815 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.013783    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl9jg\" (UniqueName: \"kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.014014 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.013891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.014014 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.013919    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.070931 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.070902    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0" path="/var/lib/kubelet/pods/c3e3eeee-bbd8-4d7c-9fc0-e722220ca6b0/volumes"
Jul 07 19:10:46.104852 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.104765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:46.115426 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.115392    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.115426 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.115427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.115692 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.115503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl9jg\" (UniqueName: \"kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.116239 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.116219    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.117893 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.117872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.125060 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.125033    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl9jg\" (UniqueName: \"kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg\") pod \"maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") " pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.156097 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.156066    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" event={"ID":"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9","Type":"ContainerStarted","Data":"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"}
Jul 07 19:10:46.156253 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.156121    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" event={"ID":"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9","Type":"ContainerStarted","Data":"720c1c382cdda4805a2ca2df046c3b75bd0630eeace1d702956f888c1fbc3f45"}
Jul 07 19:10:46.178334 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.178284    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" podStartSLOduration=2.178269349 podStartE2EDuration="2.178269349s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:46.177034721 +0000 UTC m=+1576.593326718" watchObservedRunningTime="2026-07-07 19:10:46.178269349 +0000 UTC m=+1576.594561321"
Jul 07 19:10:46.224017 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.223988    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:46.368366 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.368338    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:46.369565 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:10:46.369536    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa556d9c_3cb0_496d_ac15_6313cfee8beb.slice/crio-81c8475f9273abbe7b9741564f1b21a9fe788ec43b35015c5d73d66e0e7638e3 WatchSource:0}: Error finding container 81c8475f9273abbe7b9741564f1b21a9fe788ec43b35015c5d73d66e0e7638e3: Status 404 returned error can't find the container with id 81c8475f9273abbe7b9741564f1b21a9fe788ec43b35015c5d73d66e0e7638e3
Jul 07 19:10:46.513388 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.513357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:46.614064 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:46.614031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:47.019394 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.019372    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:47.024921 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.024898    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:47.171307 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.171269    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" event={"ID":"aa556d9c-3cb0-496d-ac15-6313cfee8beb","Type":"ContainerStarted","Data":"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"}
Jul 07 19:10:47.171500 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.171411    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" event={"ID":"aa556d9c-3cb0-496d-ac15-6313cfee8beb","Type":"ContainerStarted","Data":"81c8475f9273abbe7b9741564f1b21a9fe788ec43b35015c5d73d66e0e7638e3"}
Jul 07 19:10:47.171694 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.171672    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:47.171806 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.171722    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:47.172702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.172683    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:47.197801 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.197741    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" podStartSLOduration=1.586064607 podStartE2EDuration="2.197722181s" totalImagesPullingTime="611.657574ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:10:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:10:47.19335685 +0000 UTC m=+1577.609648822" watchObservedRunningTime="2026-07-07 19:10:47.197722181 +0000 UTC m=+1577.614014154"
Jul 07 19:10:47.953468 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:47.953434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:50.294059 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.294028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:50.464744 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.464706    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:50.465236 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.465203    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" podUID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" containerName="istio-proxy" containerID="cri-o://1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05" gracePeriod=30
Jul 07 19:10:50.483474 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.483438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:50.585692 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.585544    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:50.672866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.672814    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:50.673396 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.673362    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" podUID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" containerName="maas-api" containerID="cri-o://15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00" gracePeriod=30
Jul 07 19:10:50.688479 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.688439    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:50.988363 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:50.988337    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:51.077674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.074028    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl9jg\" (UniqueName: \"kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg\") pod \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") "
Jul 07 19:10:51.077674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.074110    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca\") pod \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") "
Jul 07 19:10:51.077674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.074144    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls\") pod \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\" (UID: \"aa556d9c-3cb0-496d-ac15-6313cfee8beb\") "
Jul 07 19:10:51.077674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.075192    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "aa556d9c-3cb0-496d-ac15-6313cfee8beb" (UID: "aa556d9c-3cb0-496d-ac15-6313cfee8beb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:51.080839 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.080808    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg" (OuterVolumeSpecName: "kube-api-access-jl9jg") pod "aa556d9c-3cb0-496d-ac15-6313cfee8beb" (UID: "aa556d9c-3cb0-496d-ac15-6313cfee8beb"). InnerVolumeSpecName "kube-api-access-jl9jg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:51.080978 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.080913    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "aa556d9c-3cb0-496d-ac15-6313cfee8beb" (UID: "aa556d9c-3cb0-496d-ac15-6313cfee8beb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:10:51.175258 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.175214    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/aa556d9c-3cb0-496d-ac15-6313cfee8beb-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:51.175258 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.175258    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl9jg\" (UniqueName: \"kubernetes.io/projected/aa556d9c-3cb0-496d-ac15-6313cfee8beb-kube-api-access-jl9jg\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:51.175540 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.175274    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/aa556d9c-3cb0-496d-ac15-6313cfee8beb-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:51.195216 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.195183    2578 generic.go:356] "Generic (PLEG): container finished" podID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" containerID="15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00" exitCode=0
Jul 07 19:10:51.195379 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.195227    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"
Jul 07 19:10:51.195379 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.195260    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" event={"ID":"aa556d9c-3cb0-496d-ac15-6313cfee8beb","Type":"ContainerDied","Data":"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"}
Jul 07 19:10:51.195379 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.195320    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7" event={"ID":"aa556d9c-3cb0-496d-ac15-6313cfee8beb","Type":"ContainerDied","Data":"81c8475f9273abbe7b9741564f1b21a9fe788ec43b35015c5d73d66e0e7638e3"}
Jul 07 19:10:51.195379 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.195348    2578 scope.go:117] "RemoveContainer" containerID="15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"
Jul 07 19:10:51.205185 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.205168    2578 scope.go:117] "RemoveContainer" containerID="15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"
Jul 07 19:10:51.205435 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:51.205416    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00\": container with ID starting with 15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00 not found: ID does not exist" containerID="15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"
Jul 07 19:10:51.205489 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.205452    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00"} err="failed to get container status \"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00\": rpc error: code = NotFound desc = could not find container \"15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00\": container with ID starting with 15616b5c15e05bbf6816668269323e5ccb28e4492d71e54138b684e46ab0ef00 not found: ID does not exist"
Jul 07 19:10:51.221048 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.221020    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:51.225469 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:51.225447    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-0c711be3-568dbb4c4f-x9pn7"]
Jul 07 19:10:52.075734 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:52.075693    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" path="/var/lib/kubelet/pods/aa556d9c-3cb0-496d-ac15-6313cfee8beb/volumes"
Jul 07 19:10:52.518415 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:52.518383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:56.784177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:56.784147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:56.861289 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:56.861257    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:57.274486 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.274434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:57.378073 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.378043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:57.478247 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.478221    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:10:57.634358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.634331    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:57.738934 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.738899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.738941    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739001    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739102    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739121    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739148    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739187    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739240    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlql6\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6\") pod \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\" (UID: \"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9\") "
Jul 07 19:10:57.739538 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739419    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:57.739599 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739531    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:57.739599 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739588    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.739724 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.739629    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:57.740106 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.740077    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:10:57.740226 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.740161    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data" (OuterVolumeSpecName: "istio-data") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:57.741253 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.741226    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:10:57.741371 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.741354    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:10:57.741474 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.741460    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token" (OuterVolumeSpecName: "istio-token") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:57.741571 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.741557    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6" (OuterVolumeSpecName: "kube-api-access-nlql6") pod "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" (UID: "8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9"). InnerVolumeSpecName "kube-api-access-nlql6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840029    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840058    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlql6\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-kube-api-access-nlql6\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840069    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840078    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840085    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840093    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840100    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:57.840112 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:57.840107    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:10:58.238916 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.238880    2578 generic.go:356] "Generic (PLEG): container finished" podID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" containerID="1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05" exitCode=0
Jul 07 19:10:58.239089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.238952    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"
Jul 07 19:10:58.239089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.238963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" event={"ID":"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9","Type":"ContainerDied","Data":"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"}
Jul 07 19:10:58.239089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.239012    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm" event={"ID":"8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9","Type":"ContainerDied","Data":"720c1c382cdda4805a2ca2df046c3b75bd0630eeace1d702956f888c1fbc3f45"}
Jul 07 19:10:58.239089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.239034    2578 scope.go:117] "RemoveContainer" containerID="1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"
Jul 07 19:10:58.248089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.248061    2578 scope.go:117] "RemoveContainer" containerID="1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"
Jul 07 19:10:58.248326 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:10:58.248308    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05\": container with ID starting with 1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05 not found: ID does not exist" containerID="1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"
Jul 07 19:10:58.248387 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.248334    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05"} err="failed to get container status \"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05\": rpc error: code = NotFound desc = could not find container \"1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05\": container with ID starting with 1a3232c208677779ef1c8199504677312f9aa61da781ec0503f3753d4c3b8a05 not found: ID does not exist"
Jul 07 19:10:58.260380 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.260354    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:58.264549 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.264527    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-0c711be3-openshift-default-654f97d6b7-gsgnm"]
Jul 07 19:10:58.862179 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:10:58.862144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:00.070870 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:00.070836    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" path="/var/lib/kubelet/pods/8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9/volumes"
Jul 07 19:11:04.996203 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:04.996170    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:05.102317 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:05.102263    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:05.203121 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:05.203083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:05.298011 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:05.297896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:05.691728 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:05.691672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:16.993220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:16.993158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:17.100027 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:17.099997    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:31.741277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:31.741244    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:38.161060 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:38.161025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:38.270005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:38.269974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:38.361088 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:38.361054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:11:54.283403 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:11:54.283371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:00.688796 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:00.688765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:00.791507 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:00.791475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:00.893430 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:00.893396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:11.412021 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:11.411982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:12.204296 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:12.204265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:18.364727 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:18.364695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:18.432913 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:18.432880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:18.513349 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:18.513306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:18.614818 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:18.614740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:18.714268 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:18.714232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:19.437038 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:19.436999    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:19.539244 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:19.539213    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:19.638422 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:19.638388    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:21.249265 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:21.249235    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:27.306445 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:27.306408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:27.364987 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:27.364957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:27.976497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:27.976466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:34.280340 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.280308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:34.799052 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799012    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:12:34.799398 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799386    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" containerName="maas-api"
Jul 07 19:12:34.799442 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799401    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" containerName="maas-api"
Jul 07 19:12:34.799442 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799420    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" containerName="istio-proxy"
Jul 07 19:12:34.799442 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799425    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" containerName="istio-proxy"
Jul 07 19:12:34.799541 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799484    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa556d9c-3cb0-496d-ac15-6313cfee8beb" containerName="maas-api"
Jul 07 19:12:34.799541 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.799497    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ed4e7f2-acc0-4e1a-862b-8a4f70cf94d9" containerName="istio-proxy"
Jul 07 19:12:34.801522 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.801507    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.804339 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.804319    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-60a1f55d-openshift-default-dockercfg-ms8xv\""
Jul 07 19:12:34.829162 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.829130    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:12:34.841909 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.841880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcjdc\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842104 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842074    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842233 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842155    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842233 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842199    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842350 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842250    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842428 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842397    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842542 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842441    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842542 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842481    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.842542 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.842510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.943791 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943759    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.943791 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943796    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943834    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcjdc\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.943928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944002    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944054    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944109    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944197    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944301    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944509 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944460    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944594    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.944761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.944743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.946166 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.946145    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.946465 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.946448    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.958130 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.958101    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:34.958920 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:34.958897    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcjdc\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc\") pod \"e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") " pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:35.111335 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.111248    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:35.257603 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.257575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:12:35.259090 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:12:35.259060    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadc62520_789e_4aa3_9bcc_ea3a471e89de.slice/crio-8967ad64c1fe9555fa04561835489fec91218c66481efc64ae7ec3ec3ed3b90b WatchSource:0}: Error finding container 8967ad64c1fe9555fa04561835489fec91218c66481efc64ae7ec3ec3ed3b90b: Status 404 returned error can't find the container with id 8967ad64c1fe9555fa04561835489fec91218c66481efc64ae7ec3ec3ed3b90b
Jul 07 19:12:35.261208 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.261178    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:35.261267 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.261244    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:35.261306 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.261276    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:35.489219 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.489172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:35.779331 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.779230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerStarted","Data":"75e7d1a39e8d3966921873103c014d4b436cb9a08a711f13dfdc6527fbd34eff"}
Jul 07 19:12:35.779331 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.779296    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerStarted","Data":"8967ad64c1fe9555fa04561835489fec91218c66481efc64ae7ec3ec3ed3b90b"}
Jul 07 19:12:35.805156 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:35.805108    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podStartSLOduration=1.805091822 podStartE2EDuration="1.805091822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:12:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:12:35.803705131 +0000 UTC m=+1686.219997116" watchObservedRunningTime="2026-07-07 19:12:35.805091822 +0000 UTC m=+1686.221383795"
Jul 07 19:12:36.112243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:36.112153    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:36.117152 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:36.117129    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:36.785200 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:36.785165    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:36.786135 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:36.786119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:37.740886 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.740857    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:37.822203 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.822162    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:37.823995 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.823976    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:37.826557 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.826541    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.829073 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.829055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-60a1f55d-serving-cert\""
Jul 07 19:12:37.829182 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.829158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:12:37.839890 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.839864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:37.873492 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.873460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.873705 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.873552    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvtrk\" (UniqueName: \"kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.873705 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.873600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.899987 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.899943    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:37.974559 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.974519    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvtrk\" (UniqueName: \"kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.974825 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.974621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.974825 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.974773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.975713 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.975688    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.977372 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.977353    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:37.984514 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:37.984490    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvtrk\" (UniqueName: \"kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk\") pod \"maas-api-e2e-mt-60a1f55d-8968d4b69-2v298\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") " pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:38.011187 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.011129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:38.137538 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.137505    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:38.281289 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.281257    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:38.282443 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:12:38.282419    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod163d87ec_cfef_4df6_8fee_014567ceecb1.slice/crio-81c79ffb937eb0ebcc455061481cd5d44a8fa05aaa3f11bcc4d739401bc6dce4 WatchSource:0}: Error finding container 81c79ffb937eb0ebcc455061481cd5d44a8fa05aaa3f11bcc4d739401bc6dce4: Status 404 returned error can't find the container with id 81c79ffb937eb0ebcc455061481cd5d44a8fa05aaa3f11bcc4d739401bc6dce4
Jul 07 19:12:38.413991 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.413963    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:38.517363 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.517326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:38.797052 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:38.797010    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" event={"ID":"163d87ec-cfef-4df6-8fee-014567ceecb1","Type":"ContainerStarted","Data":"81c79ffb937eb0ebcc455061481cd5d44a8fa05aaa3f11bcc4d739401bc6dce4"}
Jul 07 19:12:39.804712 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:39.804673    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" event={"ID":"163d87ec-cfef-4df6-8fee-014567ceecb1","Type":"ContainerStarted","Data":"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"}
Jul 07 19:12:39.805104 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:39.804788    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:39.823679 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:39.823604    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" podStartSLOduration=2.262410936 podStartE2EDuration="2.823587114s" totalImagesPullingTime="561.176178ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:12:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:12:39.823244863 +0000 UTC m=+1690.239536837" watchObservedRunningTime="2026-07-07 19:12:39.823587114 +0000 UTC m=+1690.239879088"
Jul 07 19:12:42.226580 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:42.226540    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:42.908063 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:42.908030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:43.005804 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:43.005771    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:43.353469 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:43.353369    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:45.815902 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:45.815871    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:50.030535 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.030498    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:50.132832 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.132798    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:50.420507 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.420469    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:50.804709 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.804593    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:50.804906 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.804878    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerName="maas-api" containerID="cri-o://9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b" gracePeriod=30
Jul 07 19:12:50.811539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.811359    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.56:8443/health\": dial tcp 10.133.0.56:8443: connect: connection refused"
Jul 07 19:12:50.826401 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.826372    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:50.888233 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:50.888185    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:51.064154 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.064096    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:51.222025 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.221984    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls\") pod \"163d87ec-cfef-4df6-8fee-014567ceecb1\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") "
Jul 07 19:12:51.222220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.222089    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca\") pod \"163d87ec-cfef-4df6-8fee-014567ceecb1\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") "
Jul 07 19:12:51.222220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.222136    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mvtrk\" (UniqueName: \"kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk\") pod \"163d87ec-cfef-4df6-8fee-014567ceecb1\" (UID: \"163d87ec-cfef-4df6-8fee-014567ceecb1\") "
Jul 07 19:12:51.222522 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.222489    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "163d87ec-cfef-4df6-8fee-014567ceecb1" (UID: "163d87ec-cfef-4df6-8fee-014567ceecb1"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:12:51.224354 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.224321    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk" (OuterVolumeSpecName: "kube-api-access-mvtrk") pod "163d87ec-cfef-4df6-8fee-014567ceecb1" (UID: "163d87ec-cfef-4df6-8fee-014567ceecb1"). InnerVolumeSpecName "kube-api-access-mvtrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:12:51.224354 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.224327    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "163d87ec-cfef-4df6-8fee-014567ceecb1" (UID: "163d87ec-cfef-4df6-8fee-014567ceecb1"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:12:51.323824 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.323741    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mvtrk\" (UniqueName: \"kubernetes.io/projected/163d87ec-cfef-4df6-8fee-014567ceecb1-kube-api-access-mvtrk\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:12:51.323824 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.323772    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/163d87ec-cfef-4df6-8fee-014567ceecb1-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:12:51.323824 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.323781    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/163d87ec-cfef-4df6-8fee-014567ceecb1-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:12:51.872585 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.872548    2578 generic.go:356] "Generic (PLEG): container finished" podID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerID="9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b" exitCode=0
Jul 07 19:12:51.872761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.872593    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"
Jul 07 19:12:51.872761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.872605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" event={"ID":"163d87ec-cfef-4df6-8fee-014567ceecb1","Type":"ContainerDied","Data":"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"}
Jul 07 19:12:51.872761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.872674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298" event={"ID":"163d87ec-cfef-4df6-8fee-014567ceecb1","Type":"ContainerDied","Data":"81c79ffb937eb0ebcc455061481cd5d44a8fa05aaa3f11bcc4d739401bc6dce4"}
Jul 07 19:12:51.872761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.872700    2578 scope.go:117] "RemoveContainer" containerID="9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"
Jul 07 19:12:51.887206 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.887187    2578 scope.go:117] "RemoveContainer" containerID="9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"
Jul 07 19:12:51.887492 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:12:51.887473    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b\": container with ID starting with 9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b not found: ID does not exist" containerID="9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"
Jul 07 19:12:51.887536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.887500    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b"} err="failed to get container status \"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b\": rpc error: code = NotFound desc = could not find container \"9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b\": container with ID starting with 9126b0e469fdf6e9bc36b9a410e8216870a0c1f64ce9ab9f670303b5a786861b not found: ID does not exist"
Jul 07 19:12:51.900637 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.900609    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:51.904683 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:51.904660    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-60a1f55d-8968d4b69-2v298"]
Jul 07 19:12:52.070829 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.070787    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" path="/var/lib/kubelet/pods/163d87ec-cfef-4df6-8fee-014567ceecb1/volumes"
Jul 07 19:12:52.091108 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.090993    2578 patch_prober.go:28] interesting pod/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:43888->10.133.0.55:15021: read: connection reset by peer" start-of-body=
Jul 07 19:12:52.091108 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.091068    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": read tcp 10.133.0.2:43888->10.133.0.55:15021: read: connection reset by peer"
Jul 07 19:12:52.879318 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.879287    2578 generic.go:356] "Generic (PLEG): container finished" podID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerID="75e7d1a39e8d3966921873103c014d4b436cb9a08a711f13dfdc6527fbd34eff" exitCode=0
Jul 07 19:12:52.879501 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.879360    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerDied","Data":"75e7d1a39e8d3966921873103c014d4b436cb9a08a711f13dfdc6527fbd34eff"}
Jul 07 19:12:52.879874 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.879855    2578 scope.go:117] "RemoveContainer" containerID="75e7d1a39e8d3966921873103c014d4b436cb9a08a711f13dfdc6527fbd34eff"
Jul 07 19:12:52.880891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.880867    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:52.880951 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.880929    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:52.880994 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:52.880960    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:12:53.888431 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:53.888395    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerStarted","Data":"f07765c9d02086f65a2b2170493b6dc76f92220dbd9b718493800a630729df81"}
Jul 07 19:12:54.111598 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:54.111565    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:12:54.111811 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:54.111790    2578 patch_prober.go:28] interesting pod/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 07 19:12:54.111864 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:54.111838    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 07 19:12:55.112673 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:55.112609    2578 patch_prober.go:28] interesting pod/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 07 19:12:55.113142 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:55.112707    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 07 19:12:56.112524 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:56.112483    2578 patch_prober.go:28] interesting pod/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 07 19:12:56.112755 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:56.112541    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 07 19:12:57.111991 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.111953    2578 patch_prober.go:28] interesting pod/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused" start-of-body=
Jul 07 19:12:57.112203 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.112013    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.55:15021/healthz/ready\": dial tcp 10.133.0.55:15021: connect: connection refused"
Jul 07 19:12:57.431016 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.430974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:57.531764 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.531722    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:57.732285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.732196    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:12:57.732441 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.732391    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy" containerID="cri-o://f07765c9d02086f65a2b2170493b6dc76f92220dbd9b718493800a630729df81" gracePeriod=30
Jul 07 19:12:57.774586 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:57.774548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:58.014709 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:58.014582    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:58.132841 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:58.132810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:58.233486 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:58.233451    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:12:58.377528 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:12:58.377436    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:02.937793 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:02.937764    2578 generic.go:356] "Generic (PLEG): container finished" podID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerID="f07765c9d02086f65a2b2170493b6dc76f92220dbd9b718493800a630729df81" exitCode=0
Jul 07 19:13:02.938232 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:02.937836    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerDied","Data":"f07765c9d02086f65a2b2170493b6dc76f92220dbd9b718493800a630729df81"}
Jul 07 19:13:02.938232 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:02.937916    2578 scope.go:117] "RemoveContainer" containerID="75e7d1a39e8d3966921873103c014d4b436cb9a08a711f13dfdc6527fbd34eff"
Jul 07 19:13:02.989411 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:02.989383    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:13:03.046475 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046394    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046475 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046432    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046475 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046474    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046530    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046615    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046657    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wcjdc\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc\") pod \"adc62520-789e-4aa3-9bcc-ea3a471e89de\" (UID: \"adc62520-789e-4aa3-9bcc-ea3a471e89de\") "
Jul 07 19:13:03.046753 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046711    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:13:03.047111 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.046926    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:13:03.047111 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.047053    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.047111 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.047073    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.047277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.047187    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:13:03.047457 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.047428    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:13:03.047984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.047956    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data" (OuterVolumeSpecName: "istio-data") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:13:03.048724 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.048700    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:13:03.049042 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.049024    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token" (OuterVolumeSpecName: "istio-token") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:13:03.049120 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.049080    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:13:03.049120 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.049097    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc" (OuterVolumeSpecName: "kube-api-access-wcjdc") pod "adc62520-789e-4aa3-9bcc-ea3a471e89de" (UID: "adc62520-789e-4aa3-9bcc-ea3a471e89de"). InnerVolumeSpecName "kube-api-access-wcjdc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:13:03.148003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.147969    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148001    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148009    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/adc62520-789e-4aa3-9bcc-ea3a471e89de-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148229 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148017    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148229 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148025    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wcjdc\" (UniqueName: \"kubernetes.io/projected/adc62520-789e-4aa3-9bcc-ea3a471e89de-kube-api-access-wcjdc\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148229 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148033    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.148229 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.148040    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/adc62520-789e-4aa3-9bcc-ea3a471e89de-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:03.944842 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.944812    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"
Jul 07 19:13:03.945244 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.944802    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87" event={"ID":"adc62520-789e-4aa3-9bcc-ea3a471e89de","Type":"ContainerDied","Data":"8967ad64c1fe9555fa04561835489fec91218c66481efc64ae7ec3ec3ed3b90b"}
Jul 07 19:13:03.945244 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.944937    2578 scope.go:117] "RemoveContainer" containerID="f07765c9d02086f65a2b2170493b6dc76f92220dbd9b718493800a630729df81"
Jul 07 19:13:03.971497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.971469    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:13:03.976600 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:03.976574    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-60a1f55d-openshift-default-78cddd64f5-d6r87"]
Jul 07 19:13:04.071815 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:04.071783    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" path="/var/lib/kubelet/pods/adc62520-789e-4aa3-9bcc-ea3a471e89de/volumes"
Jul 07 19:13:04.788263 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:04.788231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:04.888526 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:04.888492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:04.993398 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:04.993351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:05.149225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:05.149196    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:11.812544 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:11.812508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:11.917364 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:11.917327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:18.728672 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:18.728628    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:19.051389 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051313    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:13:19.051750 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051736    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerName="maas-api"
Jul 07 19:13:19.051802 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051752    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerName="maas-api"
Jul 07 19:13:19.051802 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051772    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051802 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051778    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051802 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051788    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051802 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051793    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051856    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051866    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="adc62520-789e-4aa3-9bcc-ea3a471e89de" containerName="istio-proxy"
Jul 07 19:13:19.051955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.051871    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="163d87ec-cfef-4df6-8fee-014567ceecb1" containerName="maas-api"
Jul 07 19:13:19.054670 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.054631    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.057859 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.057842    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-8f195932-openshift-default-dockercfg-tfrn8\""
Jul 07 19:13:19.069765 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.069742    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:13:19.084927 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.084902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:19.202303 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202266    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202303 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202361    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202386    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rchd\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202744 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.202744 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.202549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303712    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.303781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303851    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rchd\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.303944    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.304037    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304282 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.304103    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304580 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.304559    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.304745 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.304723    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.306385 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.306360    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.306483 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.306435    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.312440 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.312412    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.312774 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.312754    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rchd\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd\") pod \"e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") " pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.364472 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.364435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:19.388696 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.388665    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:19.507374 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.507350    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:13:19.508337 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:13:19.508305    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b75bb67_a67f_46b5_93ae_b9c140010386.slice/crio-c2d3ce7040e043e917909b79caf59974d5bb57d3ee98cd1e78cb1f39b96aa841 WatchSource:0}: Error finding container c2d3ce7040e043e917909b79caf59974d5bb57d3ee98cd1e78cb1f39b96aa841: Status 404 returned error can't find the container with id c2d3ce7040e043e917909b79caf59974d5bb57d3ee98cd1e78cb1f39b96aa841
Jul 07 19:13:19.510599 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.510568    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:19.510756 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.510628    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:19.510756 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:19.510672    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:20.034298 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:20.034258    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerStarted","Data":"7c2ed879f5de95c7347dec88f4e92dfe6f2117eac59a9e2abccd36816b281b3e"}
Jul 07 19:13:20.034711 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:20.034311    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerStarted","Data":"c2d3ce7040e043e917909b79caf59974d5bb57d3ee98cd1e78cb1f39b96aa841"}
Jul 07 19:13:20.059812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:20.059763    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podStartSLOduration=1.059748065 podStartE2EDuration="1.059748065s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:20.058736824 +0000 UTC m=+1730.475028808" watchObservedRunningTime="2026-07-07 19:13:20.059748065 +0000 UTC m=+1730.476040037"
Jul 07 19:13:20.364685 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:20.364588    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:20.369528 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:20.369502    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:21.040146 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:21.040116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:21.041044 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:21.041021    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:21.984241 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:21.984206    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:22.035878 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.035843    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:22.039121 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.039097    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.041975 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.041951    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-8f195932-serving-cert\""
Jul 07 19:13:22.041975 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.041967    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:13:22.048888 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.048864    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:22.070426 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.070401    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:22.131173 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.131140    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.131364 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.131260    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.131364 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.131339    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fcx2\" (UniqueName: \"kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.232897 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.232862    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.233102 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.232927    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fcx2\" (UniqueName: \"kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.233102 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.233011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.234281 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.234208    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.242549 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.242515    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.245167 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.245147    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fcx2\" (UniqueName: \"kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2\") pod \"maas-api-e2e-mt-8f195932-78c6cf7696-nbp45\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") " pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.269595 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.269568    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:22.352530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.352499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:22.496921 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.496894    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:22.498044 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:13:22.498018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80e7ab99_6479_4c71_9092_9ca39d49f3fd.slice/crio-9db9be8d684138dcffb088c7538a3ad46704782a2b221d13efd0ff9d8d8b1c4f WatchSource:0}: Error finding container 9db9be8d684138dcffb088c7538a3ad46704782a2b221d13efd0ff9d8d8b1c4f: Status 404 returned error can't find the container with id 9db9be8d684138dcffb088c7538a3ad46704782a2b221d13efd0ff9d8d8b1c4f
Jul 07 19:13:22.559865 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.559837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:22.656823 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:22.656794    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:23.052838 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:23.052800    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" event={"ID":"80e7ab99-6479-4c71-9092-9ca39d49f3fd","Type":"ContainerStarted","Data":"9daa89567e2adf7f1eec9164d6571fbaceed2f1fb3e1c4886d4e1cc8f56df3d0"}
Jul 07 19:13:23.053218 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:23.052863    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:23.053218 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:23.052884    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" event={"ID":"80e7ab99-6479-4c71-9092-9ca39d49f3fd","Type":"ContainerStarted","Data":"9db9be8d684138dcffb088c7538a3ad46704782a2b221d13efd0ff9d8d8b1c4f"}
Jul 07 19:13:23.075096 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:23.075043    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" podStartSLOduration=0.702539586 podStartE2EDuration="1.075028449s" totalImagesPullingTime="372.488863ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:13:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:13:23.073586977 +0000 UTC m=+1733.489878947" watchObservedRunningTime="2026-07-07 19:13:23.075028449 +0000 UTC m=+1733.491320421"
Jul 07 19:13:26.494869 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:26.494841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:28.921521 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:28.921472    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:29.067352 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:29.067319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:30.758951 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:30.758914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:30.861288 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:30.861063    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:36.041729 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.041620    2578 patch_prober.go:28] interesting pod/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 07 19:13:36.041729 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.041711    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 07 19:13:36.140783 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.140746    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerID="7c2ed879f5de95c7347dec88f4e92dfe6f2117eac59a9e2abccd36816b281b3e" exitCode=0
Jul 07 19:13:36.140957 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.140816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerDied","Data":"7c2ed879f5de95c7347dec88f4e92dfe6f2117eac59a9e2abccd36816b281b3e"}
Jul 07 19:13:36.141238 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.141224    2578 scope.go:117] "RemoveContainer" containerID="7c2ed879f5de95c7347dec88f4e92dfe6f2117eac59a9e2abccd36816b281b3e"
Jul 07 19:13:36.142292 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.142267    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:36.142360 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.142332    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:36.142396 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:36.142377    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:13:37.148479 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:37.148441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerStarted","Data":"759f1c761317ff682fee8463e1e5aa0345f6b2b1654127ff0361ba72ce63e5a9"}
Jul 07 19:13:37.365901 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:37.365459    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:37.365901 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:37.365584    2578 patch_prober.go:28] interesting pod/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 07 19:13:37.365901 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:37.365625    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 07 19:13:38.365333 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:38.365292    2578 patch_prober.go:28] interesting pod/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 07 19:13:38.365955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:38.365922    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 07 19:13:39.365235 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:39.365193    2578 patch_prober.go:28] interesting pod/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 07 19:13:39.365454 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:39.365262    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 07 19:13:40.366130 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:40.366078    2578 patch_prober.go:28] interesting pod/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused" start-of-body=
Jul 07 19:13:40.366657 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:40.366152    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.57:15021/healthz/ready\": dial tcp 10.133.0.57:15021: connect: connection refused"
Jul 07 19:13:41.368969 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:41.368938    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:41.369432 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:41.369320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:41.370004 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:41.369986    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:13:44.307041 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:44.307003    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:44.406628 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:44.406592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:48.663076 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:48.663039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:49.052049 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.051976    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:49.052214 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.052189    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerName="maas-api" containerID="cri-o://9daa89567e2adf7f1eec9164d6571fbaceed2f1fb3e1c4886d4e1cc8f56df3d0" gracePeriod=30
Jul 07 19:13:49.062128 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.062097    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.58:8443/health\": dial tcp 10.133.0.58:8443: connect: connection refused"
Jul 07 19:13:49.115065 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.115032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:49.222118 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.222081    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" event={"ID":"80e7ab99-6479-4c71-9092-9ca39d49f3fd","Type":"ContainerDied","Data":"9daa89567e2adf7f1eec9164d6571fbaceed2f1fb3e1c4886d4e1cc8f56df3d0"}
Jul 07 19:13:49.222277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.222159    2578 generic.go:356] "Generic (PLEG): container finished" podID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerID="9daa89567e2adf7f1eec9164d6571fbaceed2f1fb3e1c4886d4e1cc8f56df3d0" exitCode=0
Jul 07 19:13:49.302841 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.302782    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:49.389393 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.389361    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5fcx2\" (UniqueName: \"kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2\") pod \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") "
Jul 07 19:13:49.389546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.389448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls\") pod \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") "
Jul 07 19:13:49.389546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.389475    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca\") pod \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\" (UID: \"80e7ab99-6479-4c71-9092-9ca39d49f3fd\") "
Jul 07 19:13:49.389905 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.389879    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "80e7ab99-6479-4c71-9092-9ca39d49f3fd" (UID: "80e7ab99-6479-4c71-9092-9ca39d49f3fd"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:13:49.391392 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.391370    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "80e7ab99-6479-4c71-9092-9ca39d49f3fd" (UID: "80e7ab99-6479-4c71-9092-9ca39d49f3fd"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:13:49.391453 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.391372    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2" (OuterVolumeSpecName: "kube-api-access-5fcx2") pod "80e7ab99-6479-4c71-9092-9ca39d49f3fd" (UID: "80e7ab99-6479-4c71-9092-9ca39d49f3fd"). InnerVolumeSpecName "kube-api-access-5fcx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:13:49.490327 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.490278    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5fcx2\" (UniqueName: \"kubernetes.io/projected/80e7ab99-6479-4c71-9092-9ca39d49f3fd-kube-api-access-5fcx2\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:49.490327 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.490325    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/80e7ab99-6479-4c71-9092-9ca39d49f3fd-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:49.490327 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:49.490336    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/80e7ab99-6479-4c71-9092-9ca39d49f3fd-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:13:50.228994 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:50.228959    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45" event={"ID":"80e7ab99-6479-4c71-9092-9ca39d49f3fd","Type":"ContainerDied","Data":"9db9be8d684138dcffb088c7538a3ad46704782a2b221d13efd0ff9d8d8b1c4f"}
Jul 07 19:13:50.229397 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:50.229002    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"
Jul 07 19:13:50.229397 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:50.229052    2578 scope.go:117] "RemoveContainer" containerID="9daa89567e2adf7f1eec9164d6571fbaceed2f1fb3e1c4886d4e1cc8f56df3d0"
Jul 07 19:13:50.250908 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:50.250881    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:50.256828 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:50.256806    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-8f195932-78c6cf7696-nbp45"]
Jul 07 19:13:52.071095 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:52.071061    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" path="/var/lib/kubelet/pods/80e7ab99-6479-4c71-9092-9ca39d49f3fd/volumes"
Jul 07 19:13:54.712653 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:54.712617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:13:59.794638 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:13:59.794603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:36.947732 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:36.947691    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:37.752688 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:37.752636    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:43.945434 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:43.945398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:50.077166 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.077128    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:50.180043 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.180011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:50.372670 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.372580    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:14:50.372871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.372841    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy" containerID="cri-o://759f1c761317ff682fee8463e1e5aa0345f6b2b1654127ff0361ba72ce63e5a9" gracePeriod=30
Jul 07 19:14:50.377069 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.377046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:50.628237 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:50.628156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:51.702234 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:51.702202    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:51.802617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:51.802584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:51.899443 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:51.899411    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:52.698845 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:52.698815    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:52.799562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:52.799529    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:52.900180 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:52.900146    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:54.410161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:54.410127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:14:55.592208 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.592178    2578 generic.go:356] "Generic (PLEG): container finished" podID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerID="759f1c761317ff682fee8463e1e5aa0345f6b2b1654127ff0361ba72ce63e5a9" exitCode=0
Jul 07 19:14:55.592565 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.592247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerDied","Data":"759f1c761317ff682fee8463e1e5aa0345f6b2b1654127ff0361ba72ce63e5a9"}
Jul 07 19:14:55.592565 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.592311    2578 scope.go:117] "RemoveContainer" containerID="7c2ed879f5de95c7347dec88f4e92dfe6f2117eac59a9e2abccd36816b281b3e"
Jul 07 19:14:55.632685 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.632663    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:14:55.710377 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710351    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9rchd\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710587 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710587 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710587 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710587 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710493    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710587 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710525    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710594    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710750    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data\") pod \"9b75bb67-a67f-46b5-93ae-b9c140010386\" (UID: \"9b75bb67-a67f-46b5-93ae-b9c140010386\") "
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710783    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710802    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:55.710894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710831    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:55.711177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.710943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:14:55.711177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.711090    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.711177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.711111    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.711177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.711125    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.711177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.711140    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9b75bb67-a67f-46b5-93ae-b9c140010386-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.711881 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.711852    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data" (OuterVolumeSpecName: "istio-data") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:55.712956 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.712923    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token" (OuterVolumeSpecName: "istio-token") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:14:55.713043 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.713011    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd" (OuterVolumeSpecName: "kube-api-access-9rchd") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "kube-api-access-9rchd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:14:55.713043 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.713032    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:14:55.713120 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.713012    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9b75bb67-a67f-46b5-93ae-b9c140010386" (UID: "9b75bb67-a67f-46b5-93ae-b9c140010386"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:14:55.812230 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.812198    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.812230 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.812222    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.812230 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.812232    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9rchd\" (UniqueName: \"kubernetes.io/projected/9b75bb67-a67f-46b5-93ae-b9c140010386-kube-api-access-9rchd\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.812490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.812241    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:55.812490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:55.812251    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9b75bb67-a67f-46b5-93ae-b9c140010386-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:14:56.599519 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:56.599487    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"
Jul 07 19:14:56.599945 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:56.599529    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5" event={"ID":"9b75bb67-a67f-46b5-93ae-b9c140010386","Type":"ContainerDied","Data":"c2d3ce7040e043e917909b79caf59974d5bb57d3ee98cd1e78cb1f39b96aa841"}
Jul 07 19:14:56.599945 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:56.599590    2578 scope.go:117] "RemoveContainer" containerID="759f1c761317ff682fee8463e1e5aa0345f6b2b1654127ff0361ba72ce63e5a9"
Jul 07 19:14:56.623923 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:56.623896    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:14:56.635576 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:56.635555    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-8f195932-openshift-default-67678bd5dc-xd8l5"]
Jul 07 19:14:58.071609 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:14:58.071577    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" path="/var/lib/kubelet/pods/9b75bb67-a67f-46b5-93ae-b9c140010386/volumes"
Jul 07 19:15:01.141938 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:01.141882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:01.213352 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:01.213320    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:01.846901 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:01.846869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:07.917575 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:07.917538    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:08.021911 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:08.021869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:08.118420 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:08.118374    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:12.441808 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:12.441768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:18.685356 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:18.685319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:19.053081 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:19.052988    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:40.084687 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:40.084637    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.026537 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.026495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.127613 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.127576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.404242 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.404216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.784207 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784127    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:15:46.784520 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784507    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784523    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784531    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784537    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784544    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerName="maas-api"
Jul 07 19:15:46.784562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784549    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerName="maas-api"
Jul 07 19:15:46.784771 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784606    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784771 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784614    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9b75bb67-a67f-46b5-93ae-b9c140010386" containerName="istio-proxy"
Jul 07 19:15:46.784771 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.784619    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="80e7ab99-6479-4c71-9092-9ca39d49f3fd" containerName="maas-api"
Jul 07 19:15:46.787115 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.787091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.787740 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.787724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.791176 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.791156    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-0d53f1-openshift-default-dockercfg-w9dw8\""
Jul 07 19:15:46.812373 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.812345    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:15:46.892036 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892001    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892036 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892039    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892055    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892070    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892172    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892207    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892231 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892229    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892394 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892276    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-22wlh\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.892394 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.892333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.979583 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.979551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:46.992933 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.992901    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993073 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.992944    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-22wlh\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993073 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993021    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993191 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993191 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993191 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993191 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993410 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993229    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993410 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993410 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993385    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993571 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993631 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993614    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993719 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993701    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.993935 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.993916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.995265 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.995247    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:46.995866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:46.995849    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:47.008157 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.008127    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:47.024554 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.024523    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-22wlh\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh\") pod \"e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") " pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:47.097981 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.097912    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:47.261297 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.261259    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:15:47.263621 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:15:47.263595    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8b28a99_ff73_40c5_b584_0383721e55f5.slice/crio-8a164dfc32c7420f3c7e232868860c10c29d067676d020d3238a441e6fdf9fcc WatchSource:0}: Error finding container 8a164dfc32c7420f3c7e232868860c10c29d067676d020d3238a441e6fdf9fcc: Status 404 returned error can't find the container with id 8a164dfc32c7420f3c7e232868860c10c29d067676d020d3238a441e6fdf9fcc
Jul 07 19:15:47.265618 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.265590    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:47.265738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.265669    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:47.265738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.265702    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:47.885473 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.885440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerStarted","Data":"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"}
Jul 07 19:15:47.885666 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.885492    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerStarted","Data":"8a164dfc32c7420f3c7e232868860c10c29d067676d020d3238a441e6fdf9fcc"}
Jul 07 19:15:47.909829 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:47.909785    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podStartSLOduration=1.909770256 podStartE2EDuration="1.909770256s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:47.907138951 +0000 UTC m=+1878.323430937" watchObservedRunningTime="2026-07-07 19:15:47.909770256 +0000 UTC m=+1878.326062307"
Jul 07 19:15:48.098866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:48.098835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:48.103890 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:48.103868    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:48.890710 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:48.890680    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:48.891759 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:48.891740    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:15:49.879392 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:49.879357    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.008220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.008153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.011619 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.011584    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:15:50.015456 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.015432    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.018774 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.018754    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-0d53f1-serving-cert\""
Jul 07 19:15:50.019067 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.019052    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:15:50.032088 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.032064    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:15:50.111041 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.111013    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.123902 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.123867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.124050 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.123904    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv29c\" (UniqueName: \"kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.124125 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.124109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.211839 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.211810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.224989 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.224953    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.224989 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.224988    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv29c\" (UniqueName: \"kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.225176 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.225058    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.225799 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.225781    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.227453 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.227429    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.235835 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.235812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv29c\" (UniqueName: \"kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c\") pod \"maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") " pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.327038 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.327010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:50.669990 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.669962    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:15:50.670113 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:15:50.670071    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf28577a6_ad9f_4f97_8d32_7d6dae9b0314.slice/crio-eb78e91e52ae33dc77a190dc2ea4159bcac9c13dd3f74b2f5db672a4fa0fec83 WatchSource:0}: Error finding container eb78e91e52ae33dc77a190dc2ea4159bcac9c13dd3f74b2f5db672a4fa0fec83: Status 404 returned error can't find the container with id eb78e91e52ae33dc77a190dc2ea4159bcac9c13dd3f74b2f5db672a4fa0fec83
Jul 07 19:15:50.671577 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.671560    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 19:15:50.752470 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.752435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.855746 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.855715    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:50.904131 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:50.904078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" event={"ID":"f28577a6-ad9f-4f97-8d32-7d6dae9b0314","Type":"ContainerStarted","Data":"eb78e91e52ae33dc77a190dc2ea4159bcac9c13dd3f74b2f5db672a4fa0fec83"}
Jul 07 19:15:51.911992 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:51.911955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" event={"ID":"f28577a6-ad9f-4f97-8d32-7d6dae9b0314","Type":"ContainerStarted","Data":"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"}
Jul 07 19:15:51.912346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:51.912056    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:51.938862 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:51.938813    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" podStartSLOduration=2.335618511 podStartE2EDuration="2.938799015s" totalImagesPullingTime="603.180504ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:51.935272202 +0000 UTC m=+1882.351564174" watchObservedRunningTime="2026-07-07 19:15:51.938799015 +0000 UTC m=+1882.355090987"
Jul 07 19:15:54.394491 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:54.394454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:54.737721 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:54.737693    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:55.088785 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.088710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:55.094799 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.094763    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:15:55.098800 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.098786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.104003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.103973    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-02a18f-openshift-default-dockercfg-rj9b8\""
Jul 07 19:15:55.128606 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.128577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:15:55.172695 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.172655    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.172879 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.172747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.172879 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.172801    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173001 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.172901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x749\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173001 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.172944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173108 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.173004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173190 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.173148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173250 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.173184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.173250 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.173219    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274103 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274068    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274103 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274108    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x749\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274434    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274497 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274707 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274504    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274772 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274749    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274859 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274834    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.274977 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.274914    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.275186 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.275168    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.276515 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.276494    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.276712 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.276695    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.280616 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.280595    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:55.290220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.290193    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.293009 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.292989    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x749\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749\") pod \"e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") " pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.409430 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.409385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:55.562146 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:15:55.562115    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4ba50bf_f2c7_4827_b49d_9af9b8aa761b.slice/crio-9439695b7a20afe6924ea41bf04c5a6bd8f0ab77408748f1ddaf6f6cb1d569ba WatchSource:0}: Error finding container 9439695b7a20afe6924ea41bf04c5a6bd8f0ab77408748f1ddaf6f6cb1d569ba: Status 404 returned error can't find the container with id 9439695b7a20afe6924ea41bf04c5a6bd8f0ab77408748f1ddaf6f6cb1d569ba
Jul 07 19:15:55.562862 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.562835    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:15:55.564360 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.564330    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:55.564429 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.564416    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:55.564464 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.564446    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:15:55.935884 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.935846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerStarted","Data":"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"}
Jul 07 19:15:55.936080 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.935914    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerStarted","Data":"9439695b7a20afe6924ea41bf04c5a6bd8f0ab77408748f1ddaf6f6cb1d569ba"}
Jul 07 19:15:55.965115 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:55.965061    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podStartSLOduration=0.965046913 podStartE2EDuration="965.046913ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:55.96198367 +0000 UTC m=+1886.378275643" watchObservedRunningTime="2026-07-07 19:15:55.965046913 +0000 UTC m=+1886.381338886"
Jul 07 19:15:56.409727 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:56.409693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:56.414702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:56.414677    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:56.941357 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:56.941327    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:56.942165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:56.942142    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:15:57.922688 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:57.922656    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:15:57.946094 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:57.946058    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:58.036403 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.036373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:58.134579 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.134543    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:15:58.138252 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.138227    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.141431 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.141408    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-02a18f-serving-cert\""
Jul 07 19:15:58.152370 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.152342    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:15:58.179550 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.174527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:58.204093 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.204034    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfpz7\" (UniqueName: \"kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.204093 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.204097    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.204370 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.204147    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.305165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.305129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.305343 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.305230    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfpz7\" (UniqueName: \"kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.305343 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.305251    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.305435 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:15:58.305419    2578 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-inf-b-02a18f-serving-cert: secret "maas-api-e2e-inf-b-02a18f-serving-cert" not found
Jul 07 19:15:58.305481 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:15:58.305471    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls podName:302f258d-2897-4d57-86d3-3fcb7ea0eaf0 nodeName:}" failed. No retries permitted until 2026-07-07 19:15:58.805454892 +0000 UTC m=+1889.221746844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls") pod "maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" (UID: "302f258d-2897-4d57-86d3-3fcb7ea0eaf0") : secret "maas-api-e2e-inf-b-02a18f-serving-cert" not found
Jul 07 19:15:58.305786 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.305768    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.316637 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.316612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfpz7\" (UniqueName: \"kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.700115 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.700084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:58.802806 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.802774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:58.811020 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.810992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.813367 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.813345    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") pod \"maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") " pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:58.900285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:58.900245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:15:59.054672 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.054538    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:59.242606 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.242581    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:15:59.244892 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:15:59.244866    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302f258d_2897_4d57_86d3_3fcb7ea0eaf0.slice/crio-ea2bf50b34b9e16e92aeb73bb3fc86a430b55571fa8fb75951dc57be998febb8 WatchSource:0}: Error finding container ea2bf50b34b9e16e92aeb73bb3fc86a430b55571fa8fb75951dc57be998febb8: Status 404 returned error can't find the container with id ea2bf50b34b9e16e92aeb73bb3fc86a430b55571fa8fb75951dc57be998febb8
Jul 07 19:15:59.961908 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.961805    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" event={"ID":"302f258d-2897-4d57-86d3-3fcb7ea0eaf0","Type":"ContainerStarted","Data":"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"}
Jul 07 19:15:59.961908 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.961875    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" event={"ID":"302f258d-2897-4d57-86d3-3fcb7ea0eaf0","Type":"ContainerStarted","Data":"ea2bf50b34b9e16e92aeb73bb3fc86a430b55571fa8fb75951dc57be998febb8"}
Jul 07 19:15:59.962736 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.962711    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:15:59.988523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:15:59.988470    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" podStartSLOduration=1.539774597 podStartE2EDuration="1.988454091s" totalImagesPullingTime="448.679494ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:15:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:15:59.987331654 +0000 UTC m=+1890.403623628" watchObservedRunningTime="2026-07-07 19:15:59.988454091 +0000 UTC m=+1890.404746064"
Jul 07 19:16:02.456040 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:02.456005    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:04.932834 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:04.932796    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:16:04.933251 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:04.932855    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:16:06.005491 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.005458    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerID="20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814" exitCode=0
Jul 07 19:16:06.005915 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.005540    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerDied","Data":"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"}
Jul 07 19:16:06.006011 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.005998    2578 scope.go:117] "RemoveContainer" containerID="20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"
Jul 07 19:16:06.007051 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.007022    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:06.007169 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.007085    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:06.007169 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.007126    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:06.993872 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:06.993839    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:16:07.014286 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:07.014251    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerStarted","Data":"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"}
Jul 07 19:16:07.099665 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:07.099374    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:16:07.099665 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:07.099507    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 19:16:07.099665 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:07.099551    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 19:16:08.099604 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:08.099558    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 19:16:08.100101 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:08.099665    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 19:16:09.098984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:09.098947    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 19:16:09.099154 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:09.099002    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 19:16:10.098971 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:10.098937    2578 patch_prober.go:28] interesting pod/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 19:16:10.099436 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:10.098994    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 19:16:11.102638 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:11.102606    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:16:11.103059 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:11.102885    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:16:11.103550 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:11.103522    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:16:11.943489 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:11.943452    2578 patch_prober.go:28] interesting pod/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 07 19:16:11.943692 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:11.943511    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 07 19:16:12.047733 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.047620    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerID="62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e" exitCode=0
Jul 07 19:16:12.047733 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.047670    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerDied","Data":"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"}
Jul 07 19:16:12.048260 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.048241    2578 scope.go:117] "RemoveContainer" containerID="62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"
Jul 07 19:16:12.049266 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.049243    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:12.049342 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.049308    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:12.049381 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.049340    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:16:12.145524 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.145453    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:12.245614 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:12.245583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:13.056757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:13.056720    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerStarted","Data":"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"}
Jul 07 19:16:13.410285 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:13.410246    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:16:13.410689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:13.410465    2578 patch_prober.go:28] interesting pod/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 07 19:16:13.410689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:13.410512    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 07 19:16:14.410583 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:14.410550    2578 patch_prober.go:28] interesting pod/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 07 19:16:14.410999 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:14.410603    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 07 19:16:15.410664 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:15.410595    2578 patch_prober.go:28] interesting pod/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 07 19:16:15.411146 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:15.410686    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 07 19:16:16.409860 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:16.409825    2578 patch_prober.go:28] interesting pod/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body=
Jul 07 19:16:16.410047 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:16.409882    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused"
Jul 07 19:16:17.413776 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:17.413746    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:16:17.414147 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:17.414116    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:16:17.414851 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:17.414834    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:16:19.422441 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:19.422406    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:20.120622 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:20.120594    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:20.225073 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:20.225039    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:25.828937 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:25.828898    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:16:56.285263 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:16:56.285217    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:02.246111 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:02.246077    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:16.785931 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:16.785894    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:17.720495 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:17.720454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:17.886267 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:17.886238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:18.316079 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.316047    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:18.413364 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.413330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:18.600501 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.600407    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:17:18.600781 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.600749    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" podUID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" containerName="maas-api" containerID="cri-o://d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3" gracePeriod=30
Jul 07 19:17:18.634181 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.634154    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:18.855984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.855925    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:17:18.920858 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.920826    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vv29c\" (UniqueName: \"kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c\") pod \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") "
Jul 07 19:17:18.921312 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.920899    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca\") pod \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") "
Jul 07 19:17:18.921312 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.920951    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls\") pod \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\" (UID: \"f28577a6-ad9f-4f97-8d32-7d6dae9b0314\") "
Jul 07 19:17:18.921312 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.921235    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f28577a6-ad9f-4f97-8d32-7d6dae9b0314" (UID: "f28577a6-ad9f-4f97-8d32-7d6dae9b0314"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:17:18.922984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.922961    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f28577a6-ad9f-4f97-8d32-7d6dae9b0314" (UID: "f28577a6-ad9f-4f97-8d32-7d6dae9b0314"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:17:18.923154 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:18.923130    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c" (OuterVolumeSpecName: "kube-api-access-vv29c") pod "f28577a6-ad9f-4f97-8d32-7d6dae9b0314" (UID: "f28577a6-ad9f-4f97-8d32-7d6dae9b0314"). InnerVolumeSpecName "kube-api-access-vv29c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:17:19.022844 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.022810    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vv29c\" (UniqueName: \"kubernetes.io/projected/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-kube-api-access-vv29c\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:17:19.022844 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.022841    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:17:19.022844 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.022854    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f28577a6-ad9f-4f97-8d32-7d6dae9b0314-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:17:19.444332 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.444299    2578 generic.go:356] "Generic (PLEG): container finished" podID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" containerID="d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3" exitCode=0
Jul 07 19:17:19.444535 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.444344    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"
Jul 07 19:17:19.444535 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.444385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" event={"ID":"f28577a6-ad9f-4f97-8d32-7d6dae9b0314","Type":"ContainerDied","Data":"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"}
Jul 07 19:17:19.444535 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.444448    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9" event={"ID":"f28577a6-ad9f-4f97-8d32-7d6dae9b0314","Type":"ContainerDied","Data":"eb78e91e52ae33dc77a190dc2ea4159bcac9c13dd3f74b2f5db672a4fa0fec83"}
Jul 07 19:17:19.444535 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.444484    2578 scope.go:117] "RemoveContainer" containerID="d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"
Jul 07 19:17:19.454480 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.454461    2578 scope.go:117] "RemoveContainer" containerID="d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"
Jul 07 19:17:19.454777 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:17:19.454758    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3\": container with ID starting with d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3 not found: ID does not exist" containerID="d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"
Jul 07 19:17:19.454850 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.454785    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3"} err="failed to get container status \"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3\": rpc error: code = NotFound desc = could not find container \"d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3\": container with ID starting with d3c73753b31c6597711d7ae620f7b6f6fb5955de7b6a1e34ec8f894b0f988cb3 not found: ID does not exist"
Jul 07 19:17:19.476089 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.476063    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:17:19.486039 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:19.486015    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-0d53f1-df6b6c9b8-4ddm9"]
Jul 07 19:17:20.072136 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:20.072105    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" path="/var/lib/kubelet/pods/f28577a6-ad9f-4f97-8d32-7d6dae9b0314/volumes"
Jul 07 19:17:23.381928 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:23.381879    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:24.338378 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:24.338327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:24.403092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:24.403054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:17:26.250348 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:17:26.250314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:01.162614 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:01.162570    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:01.436057 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:01.435973    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:18:01.436210 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:01.436172    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy" containerID="cri-o://f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e" gracePeriod=30
Jul 07 19:18:02.443425 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.443390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:02.547345 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.547310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:02.651270 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.651238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:02.806876 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.806780    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:18:02.807055 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.807024    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" podUID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" containerName="maas-api" containerID="cri-o://cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc" gracePeriod=30
Jul 07 19:18:02.837755 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:02.837716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:03.065163 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.065101    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:18:03.145966 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.145934    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfpz7\" (UniqueName: \"kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7\") pod \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") "
Jul 07 19:18:03.146156 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.146024    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca\") pod \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") "
Jul 07 19:18:03.146156 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.146077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") pod \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\" (UID: \"302f258d-2897-4d57-86d3-3fcb7ea0eaf0\") "
Jul 07 19:18:03.146463 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.146417    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "302f258d-2897-4d57-86d3-3fcb7ea0eaf0" (UID: "302f258d-2897-4d57-86d3-3fcb7ea0eaf0"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:03.146615 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.146593    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:03.148152 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.148128    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "302f258d-2897-4d57-86d3-3fcb7ea0eaf0" (UID: "302f258d-2897-4d57-86d3-3fcb7ea0eaf0"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:03.148265 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.148248    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7" (OuterVolumeSpecName: "kube-api-access-lfpz7") pod "302f258d-2897-4d57-86d3-3fcb7ea0eaf0" (UID: "302f258d-2897-4d57-86d3-3fcb7ea0eaf0"). InnerVolumeSpecName "kube-api-access-lfpz7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:03.248115 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.248075    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:03.248115 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.248107    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfpz7\" (UniqueName: \"kubernetes.io/projected/302f258d-2897-4d57-86d3-3fcb7ea0eaf0-kube-api-access-lfpz7\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:03.696418 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.696383    2578 generic.go:356] "Generic (PLEG): container finished" podID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" containerID="cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc" exitCode=0
Jul 07 19:18:03.696846 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.696424    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"
Jul 07 19:18:03.696846 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.696455    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" event={"ID":"302f258d-2897-4d57-86d3-3fcb7ea0eaf0","Type":"ContainerDied","Data":"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"}
Jul 07 19:18:03.696846 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.696500    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m" event={"ID":"302f258d-2897-4d57-86d3-3fcb7ea0eaf0","Type":"ContainerDied","Data":"ea2bf50b34b9e16e92aeb73bb3fc86a430b55571fa8fb75951dc57be998febb8"}
Jul 07 19:18:03.696846 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.696523    2578 scope.go:117] "RemoveContainer" containerID="cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"
Jul 07 19:18:03.706556 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.706530    2578 scope.go:117] "RemoveContainer" containerID="cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"
Jul 07 19:18:03.706855 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:03.706837    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc\": container with ID starting with cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc not found: ID does not exist" containerID="cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"
Jul 07 19:18:03.706914 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.706866    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc"} err="failed to get container status \"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc\": rpc error: code = NotFound desc = could not find container \"cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc\": container with ID starting with cb64e22bf465ef608cc09c67be6d20109bf5a9c2d0c503b8de0ac8ad9c8221cc not found: ID does not exist"
Jul 07 19:18:03.728616 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.728583    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:18:03.732763 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:03.732735    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-02a18f-89bf96f56-4rx2m"]
Jul 07 19:18:04.071185 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:04.071109    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" path="/var/lib/kubelet/pods/302f258d-2897-4d57-86d3-3fcb7ea0eaf0/volumes"
Jul 07 19:18:06.688087 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.688062    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:18:06.715453 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.715370    2578 generic.go:356] "Generic (PLEG): container finished" podID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerID="f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e" exitCode=0
Jul 07 19:18:06.715453 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.715429    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"
Jul 07 19:18:06.715714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.715456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerDied","Data":"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"}
Jul 07 19:18:06.715714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.715536    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq" event={"ID":"f8b28a99-ff73-40c5-b584-0383721e55f5","Type":"ContainerDied","Data":"8a164dfc32c7420f3c7e232868860c10c29d067676d020d3238a441e6fdf9fcc"}
Jul 07 19:18:06.715714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.715557    2578 scope.go:117] "RemoveContainer" containerID="f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"
Jul 07 19:18:06.726096 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.726076    2578 scope.go:117] "RemoveContainer" containerID="20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"
Jul 07 19:18:06.734534 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.734516    2578 scope.go:117] "RemoveContainer" containerID="f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"
Jul 07 19:18:06.734792 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:06.734775    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e\": container with ID starting with f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e not found: ID does not exist" containerID="f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"
Jul 07 19:18:06.734853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.734801    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e"} err="failed to get container status \"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e\": rpc error: code = NotFound desc = could not find container \"f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e\": container with ID starting with f33288732c07e599f58c41908fc592e534331364920f8feb3b2859a0f02b320e not found: ID does not exist"
Jul 07 19:18:06.734853 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.734819    2578 scope.go:117] "RemoveContainer" containerID="20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"
Jul 07 19:18:06.735074 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:06.735058    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814\": container with ID starting with 20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814 not found: ID does not exist" containerID="20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"
Jul 07 19:18:06.735113 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.735080    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814"} err="failed to get container status \"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814\": rpc error: code = NotFound desc = could not find container \"20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814\": container with ID starting with 20d4be2282b75e770b0133fa2b08dbd3cea112aefbd59c7354ea7c4c94421814 not found: ID does not exist"
Jul 07 19:18:06.785339 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785311    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785471 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785353    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785471 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785411    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785471 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785606 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785494    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785606 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785523    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785720 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785670    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785720 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785678    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:06.785720 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785714    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-22wlh\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785855 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket\") pod \"f8b28a99-ff73-40c5-b584-0383721e55f5\" (UID: \"f8b28a99-ff73-40c5-b584-0383721e55f5\") "
Jul 07 19:18:06.785855 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.785815    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:06.786122 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.786103    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.786122 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.786114    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:06.786277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.786125    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.786277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.786139    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data" (OuterVolumeSpecName: "istio-data") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:06.786277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.786195    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:06.787674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.787636    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:06.787784 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.787761    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token" (OuterVolumeSpecName: "istio-token") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:06.787844 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.787826    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:18:06.787844 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.787835    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh" (OuterVolumeSpecName: "kube-api-access-22wlh") pod "f8b28a99-ff73-40c5-b584-0383721e55f5" (UID: "f8b28a99-ff73-40c5-b584-0383721e55f5"). InnerVolumeSpecName "kube-api-access-22wlh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:06.887466 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887433    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887466 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887460    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887466 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887470    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f8b28a99-ff73-40c5-b584-0383721e55f5-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887728 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887478    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887728 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887486    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-22wlh\" (UniqueName: \"kubernetes.io/projected/f8b28a99-ff73-40c5-b584-0383721e55f5-kube-api-access-22wlh\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887728 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887496    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:06.887728 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:06.887505    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f8b28a99-ff73-40c5-b584-0383721e55f5-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:07.040825 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:07.040798    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:18:07.045651 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:07.045617    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-0d53f1-openshift-default-5c6ffddcf5-89mcq"]
Jul 07 19:18:08.071243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:08.071209    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" path="/var/lib/kubelet/pods/f8b28a99-ff73-40c5-b584-0383721e55f5/volumes"
Jul 07 19:18:08.841070 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:08.841026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:08.941557 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:08.941526    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:09.104256 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:09.104177    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:18:09.104613 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:09.104373    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy" containerID="cri-o://70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a" gracePeriod=30
Jul 07 19:18:09.125983 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:09.125938    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:09.359848 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:09.359765    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:09.719177 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:09.719138    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:10.018507 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018431    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:10.018856 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018843    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018858    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018872    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" containerName="maas-api"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018878    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" containerName="maas-api"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018885    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" containerName="maas-api"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018892    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" containerName="maas-api"
Jul 07 19:18:10.018899 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018900    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.019077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018905    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.019077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018977    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f28577a6-ad9f-4f97-8d32-7d6dae9b0314" containerName="maas-api"
Jul 07 19:18:10.019077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018985    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.019077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.018993    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8b28a99-ff73-40c5-b584-0383721e55f5" containerName="istio-proxy"
Jul 07 19:18:10.019077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.019002    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="302f258d-2897-4d57-86d3-3fcb7ea0eaf0" containerName="maas-api"
Jul 07 19:18:10.023292 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.023272    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.025966 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.025948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-542889-openshift-default-dockercfg-xztkm\""
Jul 07 19:18:10.038001 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.037977    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:10.040165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.040145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:10.120331 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120293    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgn8m\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120425    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120461    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120488    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120520    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120563    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.120871 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.120802    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222242 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222257    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgn8m\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222364    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222419 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222394    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222761 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222841 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222819    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222928 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222912    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222938    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.222984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.222953    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.223150 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.223134    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.223233 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.223212    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.224672 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.224638    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.224831 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.224813    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.234195 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.234173    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgn8m\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.235243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.235224    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token\") pod \"e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") " pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.333702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.333622    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:10.479369 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.479341    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:10.480815 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:18:10.480789    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfecc4a74_ed77_4ce8_8611_349cab81f721.slice/crio-564e3fe49b7914d72402f907fc012d90f232e5c3a4b0a261dd5e8104597d9aca WatchSource:0}: Error finding container 564e3fe49b7914d72402f907fc012d90f232e5c3a4b0a261dd5e8104597d9aca: Status 404 returned error can't find the container with id 564e3fe49b7914d72402f907fc012d90f232e5c3a4b0a261dd5e8104597d9aca
Jul 07 19:18:10.482933 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.482900    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:10.483033 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.482984    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:10.483033 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.483025    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:10.629357 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.629273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:10.740036 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.740000    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerStarted","Data":"563260404c4c57f9144288ce927f6fd16701650bff22ed00be7987bcf5f6a795"}
Jul 07 19:18:10.740206 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:10.740049    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerStarted","Data":"564e3fe49b7914d72402f907fc012d90f232e5c3a4b0a261dd5e8104597d9aca"}
Jul 07 19:18:11.334564 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:11.334528    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:11.339801 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:11.339778    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:11.366076 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:11.366035    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podStartSLOduration=2.3660183249999998 podStartE2EDuration="2.366018325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:10.778713192 +0000 UTC m=+2021.195005164" watchObservedRunningTime="2026-07-07 19:18:11.366018325 +0000 UTC m=+2021.782310298"
Jul 07 19:18:11.746294 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:11.746263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:11.747189 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:11.747169    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:12.754248 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.754210    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:12.814836 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.814798    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:12.817586 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.817564    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:12.820426 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.820401    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4rqx\""
Jul 07 19:18:12.820700 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.820685    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-542889-serving-cert\""
Jul 07 19:18:12.829537 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.829515    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:12.834714 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.834689    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:12.903481 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.903442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:12.950631 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.950590    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:12.950631 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.950630    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n28kj\" (UniqueName: \"kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:12.950894 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:12.950738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.003756 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.003695    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:13.051718 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.051601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.051891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.051758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.051891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.051790    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n28kj\" (UniqueName: \"kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.052358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.052333    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.054188 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.054172    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.061391 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.061367    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n28kj\" (UniqueName: \"kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj\") pod \"maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") " pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.129375 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.129338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:13.278921 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.278888    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:13.280270 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:18:13.280246    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode29508df_b56f_4d10_a846_e066022eb66e.slice/crio-bfe1ef2197df1a53a33393fd540aa849d5b1903fbe322586f115e4744c43d79a WatchSource:0}: Error finding container bfe1ef2197df1a53a33393fd540aa849d5b1903fbe322586f115e4744c43d79a: Status 404 returned error can't find the container with id bfe1ef2197df1a53a33393fd540aa849d5b1903fbe322586f115e4744c43d79a
Jul 07 19:18:13.362633 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.362559    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:13.453148 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.453114    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:13.759654 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:13.759603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" event={"ID":"e29508df-b56f-4d10-a846-e066022eb66e","Type":"ContainerStarted","Data":"bfe1ef2197df1a53a33393fd540aa849d5b1903fbe322586f115e4744c43d79a"}
Jul 07 19:18:14.358095 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.358073    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:18:14.369565 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369487    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9x749\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.369745 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.369810 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369786    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.369864 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369818    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.369864 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369850    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.369966 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369923    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:14.370027 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.369974    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.370079 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370035    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.370079 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370072    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.370194 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370083    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:14.370194 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370117    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert\") pod \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\" (UID: \"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b\") "
Jul 07 19:18:14.371151 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370472    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:14.371151 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370494    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.371151 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370515    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.371151 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.370828    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:14.371151 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.371099    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data" (OuterVolumeSpecName: "istio-data") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:14.372093 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.372067    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:18:14.372212 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.372069    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token" (OuterVolumeSpecName: "istio-token") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:14.372212 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.372188    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749" (OuterVolumeSpecName: "kube-api-access-9x749") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "kube-api-access-9x749". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:14.372308 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.372292    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" (UID: "f4ba50bf-f2c7-4827-b49d-9af9b8aa761b"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:14.470955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470911    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9x749\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-kube-api-access-9x749\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.470955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470950    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.470955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470960    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.470955 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470968    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.471219 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470976    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.471219 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470983    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.471219 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.470991    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:14.767427 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.767393    2578 generic.go:356] "Generic (PLEG): container finished" podID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerID="70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a" exitCode=0
Jul 07 19:18:14.767826 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.767456    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"
Jul 07 19:18:14.767826 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.767479    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerDied","Data":"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"}
Jul 07 19:18:14.767826 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.767599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r" event={"ID":"f4ba50bf-f2c7-4827-b49d-9af9b8aa761b","Type":"ContainerDied","Data":"9439695b7a20afe6924ea41bf04c5a6bd8f0ab77408748f1ddaf6f6cb1d569ba"}
Jul 07 19:18:14.767826 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.767633    2578 scope.go:117] "RemoveContainer" containerID="70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"
Jul 07 19:18:14.769215 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.769169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" event={"ID":"e29508df-b56f-4d10-a846-e066022eb66e","Type":"ContainerStarted","Data":"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"}
Jul 07 19:18:14.769331 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.769278    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:14.777425 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.777409    2578 scope.go:117] "RemoveContainer" containerID="62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"
Jul 07 19:18:14.785702 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.785686    2578 scope.go:117] "RemoveContainer" containerID="70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"
Jul 07 19:18:14.785957 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:14.785938    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a\": container with ID starting with 70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a not found: ID does not exist" containerID="70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"
Jul 07 19:18:14.786014 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.785966    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a"} err="failed to get container status \"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a\": rpc error: code = NotFound desc = could not find container \"70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a\": container with ID starting with 70c11d345007c5b3787e41d7eeaab2f2e01bf12fabad58b627ae460549454d6a not found: ID does not exist"
Jul 07 19:18:14.786014 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.785985    2578 scope.go:117] "RemoveContainer" containerID="62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"
Jul 07 19:18:14.786212 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:14.786194    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e\": container with ID starting with 62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e not found: ID does not exist" containerID="62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"
Jul 07 19:18:14.786265 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.786217    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e"} err="failed to get container status \"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e\": rpc error: code = NotFound desc = could not find container \"62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e\": container with ID starting with 62fb7987d8de1880d7d914402dcd8fd3a5c99accfdb67e42c6c710c8fae44d1e not found: ID does not exist"
Jul 07 19:18:14.793924 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.793886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" podStartSLOduration=2.296843624 podStartE2EDuration="2.79387342s" totalImagesPullingTime="497.029796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:14.792994186 +0000 UTC m=+2025.209286161" watchObservedRunningTime="2026-07-07 19:18:14.79387342 +0000 UTC m=+2025.210165434"
Jul 07 19:18:14.812431 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.812410    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:18:14.819242 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:14.819222    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-02a18f-openshift-default-788689dd9f-6bt5r"]
Jul 07 19:18:16.070967 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:16.070934    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" path="/var/lib/kubelet/pods/f4ba50bf-f2c7-4827-b49d-9af9b8aa761b/volumes"
Jul 07 19:18:17.269984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:17.269952    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:17.826997 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:17.826965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:18.125742 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.125668    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:18.126103 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126089    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.126165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126105    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.126165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126129    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.126165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126136    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.126284 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126196    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.126284 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.126204    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4ba50bf-f2c7-4827-b49d-9af9b8aa761b" containerName="istio-proxy"
Jul 07 19:18:18.129359 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.129341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.132361 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.132341    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-283790-openshift-default-dockercfg-bfzwm\""
Jul 07 19:18:18.143908 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.143887    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:18.171413 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.171387    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:18.200179 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200138    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200179 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ttc6\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200234    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200318    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200474 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200384    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200474 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200423    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.200474 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.200460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.231893 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.231860    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:18.301065 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301029    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301065 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301078    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ttc6\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301199    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301269    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.301625 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.302040 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.301834    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.302102 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.302075    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.302636 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.302607    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.302909 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.302886    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.303005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.302964    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.304540 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.304516    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.304670 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.304551    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.315905 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.315880    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.317021 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.317004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ttc6\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6\") pod \"e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") " pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.441098 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.441068    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:18.585985 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.585959    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:18.587173 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:18:18.587150    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7b625f_f642_4389_99b3_b9280b5c696e.slice/crio-045f68ba06f94a10dc8edb3ff0db90b7d4734901aad2b2a044904239e39ed580 WatchSource:0}: Error finding container 045f68ba06f94a10dc8edb3ff0db90b7d4734901aad2b2a044904239e39ed580: Status 404 returned error can't find the container with id 045f68ba06f94a10dc8edb3ff0db90b7d4734901aad2b2a044904239e39ed580
Jul 07 19:18:18.589467 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.589435    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:18.589562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.589521    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:18.589562 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.589550    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:18.794452 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.794372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerStarted","Data":"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"}
Jul 07 19:18:18.794590 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.794452    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerStarted","Data":"045f68ba06f94a10dc8edb3ff0db90b7d4734901aad2b2a044904239e39ed580"}
Jul 07 19:18:18.824723 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:18.824636    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podStartSLOduration=0.82461639 podStartE2EDuration="824.61639ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:18.823078699 +0000 UTC m=+2029.239370673" watchObservedRunningTime="2026-07-07 19:18:18.82461639 +0000 UTC m=+2029.240908365"
Jul 07 19:18:19.441983 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:19.441950    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:19.446982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:19.446957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:19.800345 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:19.800263    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:19.801309 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:19.801287    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:20.791339 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:20.791310    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:20.811319 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:20.811291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:20.914828 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:20.914799    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:21.112047 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:21.111964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:21.262987 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:21.262953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:21.778980 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:21.778914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:21.879557 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:21.879524    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:25.350706 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.350635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:25.839909 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.839826    2578 generic.go:356] "Generic (PLEG): container finished" podID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerID="563260404c4c57f9144288ce927f6fd16701650bff22ed00be7987bcf5f6a795" exitCode=0
Jul 07 19:18:25.840102 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.839901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerDied","Data":"563260404c4c57f9144288ce927f6fd16701650bff22ed00be7987bcf5f6a795"}
Jul 07 19:18:25.840320 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.840305    2578 scope.go:117] "RemoveContainer" containerID="563260404c4c57f9144288ce927f6fd16701650bff22ed00be7987bcf5f6a795"
Jul 07 19:18:25.841339 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.841310    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:25.841448 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.841394    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:25.841448 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:25.841440    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:26.746251 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:26.746205    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:26.847658 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:26.847599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerStarted","Data":"a41de38dfefdeb2ff9152b948bf5a574f5ca5185aa0305711109a6af9af20a17"}
Jul 07 19:18:27.334810 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:27.334764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:27.335985 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:27.335962    2578 patch_prober.go:28] interesting pod/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 07 19:18:27.336054 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:27.336024    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 07 19:18:28.334689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:28.334619    2578 patch_prober.go:28] interesting pod/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 07 19:18:28.335093 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:28.334719    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 07 19:18:29.334492 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:29.334454    2578 patch_prober.go:28] interesting pod/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 07 19:18:29.334674 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:29.334523    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 07 19:18:30.334541 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:30.334501    2578 patch_prober.go:28] interesting pod/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body=
Jul 07 19:18:30.334968 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:30.334565    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused"
Jul 07 19:18:31.338445 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:31.338403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:31.338885 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:31.338815    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:31.339611 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:31.339592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:31.829772 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:31.829739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:31.929425 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:31.929386    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:33.501234 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:33.501189    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:33.890736 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:33.890612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:34.008141 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.008104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:34.112757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.112726    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:34.329678 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.329632    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:34.329902 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.329877    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" podUID="e29508df-b56f-4d10-a846-e066022eb66e" containerName="maas-api" containerID="cri-o://79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a" gracePeriod=30
Jul 07 19:18:34.375959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.375927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:34.587228 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.587166    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:34.677203 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.677170    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n28kj\" (UniqueName: \"kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj\") pod \"e29508df-b56f-4d10-a846-e066022eb66e\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") "
Jul 07 19:18:34.677370 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.677257    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls\") pod \"e29508df-b56f-4d10-a846-e066022eb66e\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") "
Jul 07 19:18:34.677370 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.677312    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca\") pod \"e29508df-b56f-4d10-a846-e066022eb66e\" (UID: \"e29508df-b56f-4d10-a846-e066022eb66e\") "
Jul 07 19:18:34.677708 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.677681    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e29508df-b56f-4d10-a846-e066022eb66e" (UID: "e29508df-b56f-4d10-a846-e066022eb66e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:34.679918 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.679895    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e29508df-b56f-4d10-a846-e066022eb66e" (UID: "e29508df-b56f-4d10-a846-e066022eb66e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 19:18:34.680017 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.679909    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj" (OuterVolumeSpecName: "kube-api-access-n28kj") pod "e29508df-b56f-4d10-a846-e066022eb66e" (UID: "e29508df-b56f-4d10-a846-e066022eb66e"). InnerVolumeSpecName "kube-api-access-n28kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:34.778713 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.778681    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e29508df-b56f-4d10-a846-e066022eb66e-maas-api-tls\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:34.778713 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.778716    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e29508df-b56f-4d10-a846-e066022eb66e-openshift-service-ca\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:34.778898 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.778734    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n28kj\" (UniqueName: \"kubernetes.io/projected/e29508df-b56f-4d10-a846-e066022eb66e-kube-api-access-n28kj\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:34.902812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.902777    2578 generic.go:356] "Generic (PLEG): container finished" podID="e29508df-b56f-4d10-a846-e066022eb66e" containerID="79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a" exitCode=0
Jul 07 19:18:34.902982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.902828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"
Jul 07 19:18:34.902982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.902859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" event={"ID":"e29508df-b56f-4d10-a846-e066022eb66e","Type":"ContainerDied","Data":"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"}
Jul 07 19:18:34.902982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.902913    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj" event={"ID":"e29508df-b56f-4d10-a846-e066022eb66e","Type":"ContainerDied","Data":"bfe1ef2197df1a53a33393fd540aa849d5b1903fbe322586f115e4744c43d79a"}
Jul 07 19:18:34.902982 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.902942    2578 scope.go:117] "RemoveContainer" containerID="79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"
Jul 07 19:18:34.912743 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.912726    2578 scope.go:117] "RemoveContainer" containerID="79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"
Jul 07 19:18:34.912978 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:34.912957    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a\": container with ID starting with 79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a not found: ID does not exist" containerID="79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"
Jul 07 19:18:34.913046 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.912990    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a"} err="failed to get container status \"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a\": rpc error: code = NotFound desc = could not find container \"79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a\": container with ID starting with 79217f6904703ff628a00847946968167e1213b032ad258c336e2b47ab24559a not found: ID does not exist"
Jul 07 19:18:34.929514 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.929485    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:34.934533 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:34.934512    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-542889-7b5c96bbb4-7vxwj"]
Jul 07 19:18:35.841801 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:35.841762    2578 patch_prober.go:28] interesting pod/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 19:18:35.842171 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:35.841827    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 19:18:36.071273 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:36.071243    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e29508df-b56f-4d10-a846-e066022eb66e" path="/var/lib/kubelet/pods/e29508df-b56f-4d10-a846-e066022eb66e/volumes"
Jul 07 19:18:37.922555 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.922523    2578 generic.go:356] "Generic (PLEG): container finished" podID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerID="e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e" exitCode=0
Jul 07 19:18:37.923028 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.922594    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerDied","Data":"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"}
Jul 07 19:18:37.923028 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.923016    2578 scope.go:117] "RemoveContainer" containerID="e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"
Jul 07 19:18:37.924003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.923977    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:37.924060 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.924046    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:37.924100 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:37.924083    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:38.929695 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:38.929661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerStarted","Data":"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"}
Jul 07 19:18:39.442125 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:39.442094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:39.442339 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:39.442310    2578 patch_prober.go:28] interesting pod/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 19:18:39.442422 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:39.442386    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 19:18:40.441895 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.441857    2578 patch_prober.go:28] interesting pod/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 19:18:40.442305 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.441922    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 19:18:40.559656 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.559606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:40.661033 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.660996    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:40.827325 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.827229    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:40.827552 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.827524    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy" containerID="cri-o://a41de38dfefdeb2ff9152b948bf5a574f5ca5185aa0305711109a6af9af20a17" gracePeriod=30
Jul 07 19:18:40.846250 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:40.846211    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:41.083121 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.083024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:41.273567 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.273523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:41.441984 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.441949    2578 patch_prober.go:28] interesting pod/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 19:18:41.442362 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.442003    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 19:18:41.685722 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.685682    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:41.884099 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.884008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:41.982820 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:41.982785    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:42.260669 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:42.259800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:42.442480 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:42.442444    2578 patch_prober.go:28] interesting pod/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused" start-of-body=
Jul 07 19:18:42.442895 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:42.442500    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.65:15021/healthz/ready\": dial tcp 10.133.0.65:15021: connect: connection refused"
Jul 07 19:18:43.445355 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:43.445323    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:43.445749 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:43.445601    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:43.446276 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:43.446260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:45.973976 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:45.973940    2578 generic.go:356] "Generic (PLEG): container finished" podID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerID="a41de38dfefdeb2ff9152b948bf5a574f5ca5185aa0305711109a6af9af20a17" exitCode=0
Jul 07 19:18:45.974412 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:45.974016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerDied","Data":"a41de38dfefdeb2ff9152b948bf5a574f5ca5185aa0305711109a6af9af20a17"}
Jul 07 19:18:45.974412 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:45.974089    2578 scope.go:117] "RemoveContainer" containerID="563260404c4c57f9144288ce927f6fd16701650bff22ed00be7987bcf5f6a795"
Jul 07 19:18:46.094832 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.094771    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:46.212114 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212311 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212123    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212311 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212154    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212311 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212281    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgn8m\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212345    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212395    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212429    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212490 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212472    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212730 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212513    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs\") pod \"fecc4a74-ed77-4ce8-8611-349cab81f721\" (UID: \"fecc4a74-ed77-4ce8-8611-349cab81f721\") "
Jul 07 19:18:46.212730 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212587    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:46.213105 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212950    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.213105 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.212995    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:46.213105 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.213035    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:46.213105 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.213056    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:46.213457 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.213434    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data" (OuterVolumeSpecName: "istio-data") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:46.214530 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.214502    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token" (OuterVolumeSpecName: "istio-token") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:46.214611 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.214552    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:46.214788 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.214763    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:18:46.214877 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.214786    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m" (OuterVolumeSpecName: "kube-api-access-kgn8m") pod "fecc4a74-ed77-4ce8-8611-349cab81f721" (UID: "fecc4a74-ed77-4ce8-8611-349cab81f721"). InnerVolumeSpecName "kube-api-access-kgn8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:46.314539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314503    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgn8m\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-kube-api-access-kgn8m\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314536    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314550    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314559    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314567    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/fecc4a74-ed77-4ce8-8611-349cab81f721-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314574    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/fecc4a74-ed77-4ce8-8611-349cab81f721-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314582    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.314757 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.314588    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/fecc4a74-ed77-4ce8-8611-349cab81f721-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:46.981042 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.981011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"
Jul 07 19:18:46.981447 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.981051    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c" event={"ID":"fecc4a74-ed77-4ce8-8611-349cab81f721","Type":"ContainerDied","Data":"564e3fe49b7914d72402f907fc012d90f232e5c3a4b0a261dd5e8104597d9aca"}
Jul 07 19:18:46.981447 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:46.981103    2578 scope.go:117] "RemoveContainer" containerID="a41de38dfefdeb2ff9152b948bf5a574f5ca5185aa0305711109a6af9af20a17"
Jul 07 19:18:47.011146 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:47.011118    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:47.015941 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:47.015912    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-542889-openshift-default-66fbf74cf9-2nw4c"]
Jul 07 19:18:48.071185 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.071148    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" path="/var/lib/kubelet/pods/fecc4a74-ed77-4ce8-8611-349cab81f721/volumes"
Jul 07 19:18:48.229552 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.229513    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:48.291274 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.291239    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:48.470013 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.469979    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:48.470237 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.470206    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy" containerID="cri-o://cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821" gracePeriod=30
Jul 07 19:18:48.487279 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.487255    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:48.712534 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:48.712499    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:49.083732 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.083701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:49.401820 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.401790    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:18:49.402180 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402168    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:49.402245 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402182    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:49.402245 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402195    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e29508df-b56f-4d10-a846-e066022eb66e" containerName="maas-api"
Jul 07 19:18:49.402245 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402201    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e29508df-b56f-4d10-a846-e066022eb66e" containerName="maas-api"
Jul 07 19:18:49.402342 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402275    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:49.402342 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.402286    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e29508df-b56f-4d10-a846-e066022eb66e" containerName="maas-api"
Jul 07 19:18:49.405298 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.405280    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.409332 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.409311    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-dedce5-openshift-default-dockercfg-fj2kl\""
Jul 07 19:18:49.426695 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.426661    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:18:49.432109 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.432084    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:49.445444 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445417    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445555 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445555 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445500    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445555 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445555 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445549    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445718 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hscs\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445718 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445665    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445718 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.445826 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.445717    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.546881 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.546843    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.546898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.546922    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.546945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547061 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.546962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547057    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hscs\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547168    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547225 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547489 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547461    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547660 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547820 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547902 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547799    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.547902 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.547838    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.549325 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.549302    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.549500 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.549484    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.556904 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.556877    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hscs\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.556994 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.556875    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token\") pod \"e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") " pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.712186 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.712105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:49.716220 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.716201    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:49.862772 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.862733    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:18:49.864251 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:18:49.864226    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8c7c8cb_09e6_464c_8645_a64aa39bf87f.slice/crio-2f79f15de918f5c039a31695f0484e98be0129db5e151a80f15091f897ca6743 WatchSource:0}: Error finding container 2f79f15de918f5c039a31695f0484e98be0129db5e151a80f15091f897ca6743: Status 404 returned error can't find the container with id 2f79f15de918f5c039a31695f0484e98be0129db5e151a80f15091f897ca6743
Jul 07 19:18:49.866794 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.866763    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:49.866895 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.866838    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:49.866895 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:49.866881    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:50.000600 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:50.000495    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerStarted","Data":"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"}
Jul 07 19:18:50.000600 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:50.000553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerStarted","Data":"2f79f15de918f5c039a31695f0484e98be0129db5e151a80f15091f897ca6743"}
Jul 07 19:18:50.028094 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:50.028041    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podStartSLOduration=1.028025605 podStartE2EDuration="1.028025605s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:50.024529989 +0000 UTC m=+2060.440821963" watchObservedRunningTime="2026-07-07 19:18:50.028025605 +0000 UTC m=+2060.444317638"
Jul 07 19:18:50.716887 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:50.716847    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:50.721898 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:50.721870    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:51.006159 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:51.006081    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:51.006928 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:51.006906    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:18:52.073835 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.073806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:52.169254 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.169174    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:52.271077 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.271044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:52.464772 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.464737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:52.828881 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.828777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:52.925295 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:52.925234    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:53.729051 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.729025    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:53.795663 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795554    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795663 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795586    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795663 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795613    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ttc6\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795683    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795745    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795776    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795805    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795838    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795871    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs\") pod \"1c7b625f-f642-4389-99b3-b9280b5c696e\" (UID: \"1c7b625f-f642-4389-99b3-b9280b5c696e\") "
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795869    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:53.795959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.795911    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:53.796358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796113    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:53.796358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796278    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:18:53.796358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796318    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.796358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796336    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.796358 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796349    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.796622 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.796555    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data" (OuterVolumeSpecName: "istio-data") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:53.797954 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.797927    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6" (OuterVolumeSpecName: "kube-api-access-6ttc6") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "kube-api-access-6ttc6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:53.798082 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.798003    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token" (OuterVolumeSpecName: "istio-token") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:18:53.798203 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.798187    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:18:53.798259 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.798246    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1c7b625f-f642-4389-99b3-b9280b5c696e" (UID: "1c7b625f-f642-4389-99b3-b9280b5c696e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:18:53.897738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897697    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.897738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897732    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.897738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897744    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.897983 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897757    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ttc6\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-kube-api-access-6ttc6\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.897983 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897769    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1c7b625f-f642-4389-99b3-b9280b5c696e-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:53.897983 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:53.897780    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1c7b625f-f642-4389-99b3-b9280b5c696e-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:18:54.025378 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.025343    2578 generic.go:356] "Generic (PLEG): container finished" podID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerID="cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821" exitCode=0
Jul 07 19:18:54.025546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.025388    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"
Jul 07 19:18:54.025546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.025406    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerDied","Data":"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"}
Jul 07 19:18:54.025546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.025490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp" event={"ID":"1c7b625f-f642-4389-99b3-b9280b5c696e","Type":"ContainerDied","Data":"045f68ba06f94a10dc8edb3ff0db90b7d4734901aad2b2a044904239e39ed580"}
Jul 07 19:18:54.025546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.025520    2578 scope.go:117] "RemoveContainer" containerID="cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"
Jul 07 19:18:54.035473 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.035452    2578 scope.go:117] "RemoveContainer" containerID="e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"
Jul 07 19:18:54.043512 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.043495    2578 scope.go:117] "RemoveContainer" containerID="cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"
Jul 07 19:18:54.043769 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:54.043748    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821\": container with ID starting with cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821 not found: ID does not exist" containerID="cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"
Jul 07 19:18:54.043838 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.043776    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821"} err="failed to get container status \"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821\": rpc error: code = NotFound desc = could not find container \"cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821\": container with ID starting with cf2c329c201b57c18acf037e8867d6b46c502978ad7f967b6d0e6ff7f20bd821 not found: ID does not exist"
Jul 07 19:18:54.043838 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.043792    2578 scope.go:117] "RemoveContainer" containerID="e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"
Jul 07 19:18:54.044015 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:18:54.043997    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e\": container with ID starting with e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e not found: ID does not exist" containerID="e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"
Jul 07 19:18:54.044053 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.044023    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e"} err="failed to get container status \"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e\": rpc error: code = NotFound desc = could not find container \"e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e\": container with ID starting with e90ce5b4b0cfbf90d2e8fe5324b65fa4886b030ab8b0504f1810473b7e6e932e not found: ID does not exist"
Jul 07 19:18:54.050508 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.050457    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:54.055636 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.055613    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-283790-openshift-default-57d77ff5f9-dmpsp"]
Jul 07 19:18:54.071066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:54.071046    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" path="/var/lib/kubelet/pods/1c7b625f-f642-4389-99b3-b9280b5c696e/volumes"
Jul 07 19:18:56.464202 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:56.464169    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:56.842173 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:56.842093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:57.157328 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157302    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:18:57.157904 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157883    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:57.157969 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157908    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:57.157969 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157943    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:18:57.157969 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157952    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:18:57.157969 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157966    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:18:57.158119 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.157974    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:18:57.158119 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.158043    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:18:57.158119 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.158056    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fecc4a74-ed77-4ce8-8611-349cab81f721" containerName="istio-proxy"
Jul 07 19:18:57.161133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.161117    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.164461 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.164440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-d57d53-openshift-default-dockercfg-w7gsc\""
Jul 07 19:18:57.172380 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.172357    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:18:57.182348 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.182323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:57.230018 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.229988    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230163 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230163 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230045    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230163 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230110    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230163 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230142    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230322 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230168    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230322 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230322 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230300    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.230411 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.230335    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddmc2\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.269353 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.269317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:18:57.331512 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331474    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddmc2\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.331512 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.331787 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.331787 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331564    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.331787 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.331787 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331754    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331792    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331884    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332003 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.331947    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332168 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.332083    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332296 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.332267    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332386 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.332329    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.332536 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.332514    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.333213 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.333173    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.334297 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.334258    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.334444 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.334424    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.346369 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.346339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.346939 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.346915    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddmc2\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2\") pod \"e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") " pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.472423 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.472339    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:57.618964 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.618941    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:18:57.620879 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:18:57.620852    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd91e82d_e48d_474a_a983_54c3aedcdbaf.slice/crio-9badd480ff4e8992169936808cb2ad1f9f04f90b21b91c006586849377386f2c WatchSource:0}: Error finding container 9badd480ff4e8992169936808cb2ad1f9f04f90b21b91c006586849377386f2c: Status 404 returned error can't find the container with id 9badd480ff4e8992169936808cb2ad1f9f04f90b21b91c006586849377386f2c
Jul 07 19:18:57.622996 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.622962    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:57.623085 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.623028    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:57.623085 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:57.623057    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:18:58.050546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:58.050506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerStarted","Data":"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"}
Jul 07 19:18:58.050759 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:58.050563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerStarted","Data":"9badd480ff4e8992169936808cb2ad1f9f04f90b21b91c006586849377386f2c"}
Jul 07 19:18:58.078079 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:58.078016    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podStartSLOduration=1.077992132 podStartE2EDuration="1.077992132s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 19:18:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:18:58.075963589 +0000 UTC m=+2068.492255563" watchObservedRunningTime="2026-07-07 19:18:58.077992132 +0000 UTC m=+2068.494284108"
Jul 07 19:18:58.472895 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:58.472854    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:58.481172 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:58.481136    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:59.059097 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:59.059064    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:18:59.064119 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:18:59.064094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:19:00.053993 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:00.053958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:00.154748 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:00.154634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:00.383747 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:00.382995    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:00.617012 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:00.616985    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:00.923193 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:00.923150    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:01.023468 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:01.023416    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:04.560717 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:04.560660    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:05.101492 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.101460    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerID="54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5" exitCode=0
Jul 07 19:19:05.101777 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.101521    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerDied","Data":"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"}
Jul 07 19:19:05.101952 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.101936    2578 scope.go:117] "RemoveContainer" containerID="54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"
Jul 07 19:19:05.102951 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.102925    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:05.103050 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.102991    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:05.103050 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:05.103023    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:06.006436 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:06.006395    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:19:06.108592 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:06.108549    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerStarted","Data":"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"}
Jul 07 19:19:06.716736 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:06.716693    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:19:06.718127 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:06.718102    2578 patch_prober.go:28] interesting pod/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:19:06.718264 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:06.718162    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:19:07.717092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:07.717048    2578 patch_prober.go:28] interesting pod/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:19:07.717523 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:07.717116    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:19:08.717212 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:08.717169    2578 patch_prober.go:28] interesting pod/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:19:08.717598 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:08.717235    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:19:09.717036 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:09.717000    2578 patch_prober.go:28] interesting pod/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused" start-of-body=
Jul 07 19:19:09.717226 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:09.717067    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.66:15021/healthz/ready\": dial tcp 10.133.0.66:15021: connect: connection refused"
Jul 07 19:19:10.721152 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:10.721120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:19:10.721556 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:10.721410    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:19:10.722017 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:10.722000    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:19:14.060689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:14.060629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:14.161363 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:14.161330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:14.738404 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:14.738372    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:50242->10.133.0.67:15021: read: connection reset by peer" start-of-body=
Jul 07 19:19:14.738583 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:14.738439    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": read tcp 10.133.0.2:50242->10.133.0.67:15021: read: connection reset by peer"
Jul 07 19:19:15.161657 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.161614    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerID="7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136" exitCode=0
Jul 07 19:19:15.162132 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.161691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerDied","Data":"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"}
Jul 07 19:19:15.162248 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.162220    2578 scope.go:117] "RemoveContainer" containerID="7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"
Jul 07 19:19:15.163788 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.163733    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:15.163930 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.163911    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:15.164028 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:15.164010    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 07 19:19:16.174810 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:16.174767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerStarted","Data":"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"}
Jul 07 19:19:16.473296 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:16.473195    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:19:16.473669 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:16.473560    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 07 19:19:16.473866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:16.473840    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 07 19:19:17.473701 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:17.473660    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 07 19:19:17.474318 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:17.474286    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 07 19:19:18.474666 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:18.474607    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 07 19:19:18.475164 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:18.474697    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 07 19:19:19.474074 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:19.473590    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused" start-of-body=
Jul 07 19:19:19.474074 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:19.473672    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.67:15021/healthz/ready\": dial tcp 10.133.0.67:15021: connect: connection refused"
Jul 07 19:19:20.476252 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:20.476218    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:19:20.476612 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:20.476500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:19:20.477234 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:20.477215    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:19:22.560548 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:22.560512    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:22.864970 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:22.864932    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:22.967546 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:22.967509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:19:44.196007 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:19:44.195972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:34.363655 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:21:34.363621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:40.572681 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:21:40.572617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:41.379685 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:21:41.379629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:21:57.635150 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:21:57.635075    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:06.082657 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:22:06.082606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:22:22.074252 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:22:22.074220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:03.509272 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:03.509237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:04.669270 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:04.669231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:11.670282 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:11.670232    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:32.796681 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:32.796630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:32.899862 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:32.899826    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:36.501748 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:36.501707    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:23:37.756897 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:23:37.756839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:15.374078 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:15.374021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:15.474097 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:15.474061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:24.431354 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:24.431306    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:24.525797 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:24.525768    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:25.582100 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:25.582061    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:26.452832 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:26.452801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:27.515262 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:27.515224    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:27.930896 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:27.930864    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:28.044467 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:28.044432    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:28.158986 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:28.158948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:28.396127 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:28.396045    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:32.986696 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:32.986662    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:35.261193 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:35.261163    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:48.570526 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:48.570490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:24:48.670800 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:24:48.670762    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:10.981389 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:10.981307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:11.272197 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:11.272098    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:25:11.272472 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:11.272421    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy" containerID="cri-o://36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70" gracePeriod=30
Jul 07 19:25:11.288959 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:11.288931    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:11.550745 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:11.550664    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:11.858119 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:11.858029    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:12.257075 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:12.257046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:12.547048 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:12.546947    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:12.652332 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:12.652291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:13.030738 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:13.030697    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:16.534454 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.534398    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:25:16.602974 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.602940    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603009    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603039    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hscs\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603077    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603161 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603127    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603565 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603513    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:16.603565 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603520    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:16.603775 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603624    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:25:16.603775 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603200    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603790    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.603891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603848    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.604001 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.603889    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data\") pod \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\" (UID: \"e8c7c8cb-09e6-464c-8645-a64aa39bf87f\") "
Jul 07 19:25:16.604300 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.604262    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:16.604409 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.604346    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.604409 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.604384    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.604409 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.604399    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.605173 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.605141    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data" (OuterVolumeSpecName: "istio-data") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:16.605503 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.605468    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token" (OuterVolumeSpecName: "istio-token") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:16.605703 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.605675    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:25:16.606038 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.606016    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:16.606322 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.606297    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs" (OuterVolumeSpecName: "kube-api-access-5hscs") pod "e8c7c8cb-09e6-464c-8645-a64aa39bf87f" (UID: "e8c7c8cb-09e6-464c-8645-a64aa39bf87f"). InnerVolumeSpecName "kube-api-access-5hscs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:16.705617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705583    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.705617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705613    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.705617 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705622    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.705877 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705630    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.705877 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705637    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:16.705877 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:16.705669    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hscs\" (UniqueName: \"kubernetes.io/projected/e8c7c8cb-09e6-464c-8645-a64aa39bf87f-kube-api-access-5hscs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:17.165031 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.165000    2578 generic.go:356] "Generic (PLEG): container finished" podID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerID="36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70" exitCode=0
Jul 07 19:25:17.165243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.165064    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"
Jul 07 19:25:17.165243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.165067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerDied","Data":"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"}
Jul 07 19:25:17.165243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.165184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv" event={"ID":"e8c7c8cb-09e6-464c-8645-a64aa39bf87f","Type":"ContainerDied","Data":"2f79f15de918f5c039a31695f0484e98be0129db5e151a80f15091f897ca6743"}
Jul 07 19:25:17.165243 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.165207    2578 scope.go:117] "RemoveContainer" containerID="36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"
Jul 07 19:25:17.176268 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.176236    2578 scope.go:117] "RemoveContainer" containerID="54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"
Jul 07 19:25:17.184963 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.184939    2578 scope.go:117] "RemoveContainer" containerID="36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"
Jul 07 19:25:17.185263 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:25:17.185239    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70\": container with ID starting with 36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70 not found: ID does not exist" containerID="36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"
Jul 07 19:25:17.185337 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.185277    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70"} err="failed to get container status \"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70\": rpc error: code = NotFound desc = could not find container \"36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70\": container with ID starting with 36d4572d3829de722e273ee2d18f790d8b831a7bacc1c1a14d6f9a4e44841a70 not found: ID does not exist"
Jul 07 19:25:17.185337 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.185301    2578 scope.go:117] "RemoveContainer" containerID="54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"
Jul 07 19:25:17.185565 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:25:17.185541    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5\": container with ID starting with 54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5 not found: ID does not exist" containerID="54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"
Jul 07 19:25:17.185628 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.185572    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5"} err="failed to get container status \"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5\": rpc error: code = NotFound desc = could not find container \"54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5\": container with ID starting with 54b230d4e98481a430981205ec153cdd74d770aebf92200cc30d5bf105e729d5 not found: ID does not exist"
Jul 07 19:25:17.201368 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.201345    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:25:17.211713 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:17.211628    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-dedce5-openshift-default-6f8d6ff55f-hcmgv"]
Jul 07 19:25:18.071176 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:18.071142    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" path="/var/lib/kubelet/pods/e8c7c8cb-09e6-464c-8645-a64aa39bf87f/volumes"
Jul 07 19:25:19.298364 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.298335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:19.370816 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.370786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:19.637348 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.637258    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:19.637348 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.637325    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:25:19.637567 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.637529    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" containerID="cri-o://14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398" gracePeriod=30
Jul 07 19:25:19.867705 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:19.867672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:20.479290 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:20.479259    2578 patch_prober.go:28] interesting pod/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 19:25:20.479684 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:20.479326    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 19:25:21.728633 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:21.728600    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:21.828933 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:21.828901    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:24.890361 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.890338    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:25:24.891351 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891332    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ddmc2\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891402 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891367    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891435 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891402    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891435 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891421    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891477    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891539 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891667 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891596    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891667 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891633    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891780 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891674    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo\") pod \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\" (UID: \"bd91e82d-e48d-474a-a983-54c3aedcdbaf\") "
Jul 07 19:25:24.891840 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891776    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:24.892239 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.891930    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:24.892239 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.892020    2578 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-credential-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.892239 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.892040    2578 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-certs\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.892239 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.892065    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:24.892502 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.892354    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 19:25:24.892561 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.892536    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data" (OuterVolumeSpecName: "istio-data") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:24.893583 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.893555    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token" (OuterVolumeSpecName: "istio-token") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:24.893688 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.893580    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2" (OuterVolumeSpecName: "kube-api-access-ddmc2") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "kube-api-access-ddmc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 19:25:24.894278 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.894250    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 19:25:24.894278 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.894253    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "bd91e82d-e48d-474a-a983-54c3aedcdbaf" (UID: "bd91e82d-e48d-474a-a983-54c3aedcdbaf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 19:25:24.972791 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.972757    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mh6rm_6cf269fc-cbc2-4c1a-8a05-d7b5b169a983/manager/0.log"
Jul 07 19:25:24.992812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992793    2578 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-data\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.992812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992812    2578 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-envoy\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.992812 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992821    2578 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istiod-ca-cert\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.993005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992831    2578 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/bd91e82d-e48d-474a-a983-54c3aedcdbaf-workload-socket\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.993005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992839    2578 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-podinfo\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.993005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992847    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ddmc2\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-kube-api-access-ddmc2\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:24.993005 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:24.992855    2578 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/bd91e82d-e48d-474a-a983-54c3aedcdbaf-istio-token\") on node \"ip-10-0-141-88.ec2.internal\" DevicePath \"\""
Jul 07 19:25:25.091253 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.091221    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cmgvd_4a5b14b6-a505-4576-b725-f69047c2bcff/manager/0.log"
Jul 07 19:25:25.212981 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.212901    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74fb8746bf-x2xdx_c4d3e503-8f6f-4445-ac03-b4bd82cceaea/maas-api/0.log"
Jul 07 19:25:25.213974 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.213942    2578 generic.go:356] "Generic (PLEG): container finished" podID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerID="14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398" exitCode=0
Jul 07 19:25:25.214092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.213989    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"
Jul 07 19:25:25.214092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.214018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerDied","Data":"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"}
Jul 07 19:25:25.214092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.214070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h" event={"ID":"bd91e82d-e48d-474a-a983-54c3aedcdbaf","Type":"ContainerDied","Data":"9badd480ff4e8992169936808cb2ad1f9f04f90b21b91c006586849377386f2c"}
Jul 07 19:25:25.214092 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.214086    2578 scope.go:117] "RemoveContainer" containerID="14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"
Jul 07 19:25:25.223484 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.223468    2578 scope.go:117] "RemoveContainer" containerID="7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"
Jul 07 19:25:25.231771 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.231755    2578 scope.go:117] "RemoveContainer" containerID="14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"
Jul 07 19:25:25.231995 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:25:25.231975    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398\": container with ID starting with 14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398 not found: ID does not exist" containerID="14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"
Jul 07 19:25:25.232044 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.232003    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398"} err="failed to get container status \"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398\": rpc error: code = NotFound desc = could not find container \"14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398\": container with ID starting with 14ef978cc9be00e8625cd9f214d14f26499adbb0173a7a2ab0cf1c1345a4e398 not found: ID does not exist"
Jul 07 19:25:25.232044 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.232020    2578 scope.go:117] "RemoveContainer" containerID="7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"
Jul 07 19:25:25.232274 ip-10-0-141-88 kubenswrapper[2578]: E0707 19:25:25.232256    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136\": container with ID starting with 7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136 not found: ID does not exist" containerID="7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"
Jul 07 19:25:25.232314 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.232280    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136"} err="failed to get container status \"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136\": rpc error: code = NotFound desc = could not find container \"7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136\": container with ID starting with 7e8d23d54a29d36401eb0c611b29ec218f552e077684032e8b642210f500e136 not found: ID does not exist"
Jul 07 19:25:25.245668 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.245627    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:25:25.250729 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.250704    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-d57d53-openshift-default-67fb7dc8b7-vj67h"]
Jul 07 19:25:25.575056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.574975    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69fc6dbcbd-5294q_0ffaf4e4-a3d2-48a5-825d-d005c1410d2a/manager/0.log"
Jul 07 19:25:25.696102 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.696073    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gwsc6_67f37f3e-bba9-4f8c-8bff-c1633913f89e/server/0.log"
Jul 07 19:25:25.816885 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:25.816854    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7d74d_264e3a05-34a1-4938-a276-0a9ab162ab99/manager/0.log"
Jul 07 19:25:26.071434 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:26.071401    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" path="/var/lib/kubelet/pods/bd91e82d-e48d-474a-a983-54c3aedcdbaf/volumes"
Jul 07 19:25:26.184807 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:26.184778    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-mhvtj_d52be4d5-67eb-49c8-a6ca-76bca7d7734d/manager/0.log"
Jul 07 19:25:26.191911 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:26.191888    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-mhvtj_d52be4d5-67eb-49c8-a6ca-76bca7d7734d/copy-manifests/0.log"
Jul 07 19:25:27.084214 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.084185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/util/0.log"
Jul 07 19:25:27.092514 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.092486    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/pull/0.log"
Jul 07 19:25:27.100582 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.100558    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/extract/0.log"
Jul 07 19:25:27.214908 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.214870    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/util/0.log"
Jul 07 19:25:27.222910 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.222875    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/pull/0.log"
Jul 07 19:25:27.229847 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.229826    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/extract/0.log"
Jul 07 19:25:27.336534 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.336447    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/util/0.log"
Jul 07 19:25:27.344128 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.344106    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/pull/0.log"
Jul 07 19:25:27.350938 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.350922    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/extract/0.log"
Jul 07 19:25:27.468723 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.468696    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/extract/0.log"
Jul 07 19:25:27.481048 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.481028    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/util/0.log"
Jul 07 19:25:27.488571 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.488552    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/pull/0.log"
Jul 07 19:25:27.735277 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:27.735247    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2lpp5_a1c4fa8e-8bbb-49a2-a824-fff73dc14693/manager/0.log"
Jul 07 19:25:28.921107 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:28.921077    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4qmlh_ff4337c5-ff73-4d2c-99a4-798ff7010ca3/discovery/0.log"
Jul 07 19:25:29.152813 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:29.152783    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d58d67c5c-rzhcf_5050efce-31cf-450b-b23d-1536876602c1/kube-auth-proxy/0.log"
Jul 07 19:25:29.275552 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:29.275467    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/1.log"
Jul 07 19:25:29.399236 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:29.399192    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qmwhh_b6addf0c-dfad-48e5-b702-b8977049f1d3/payload-pre-processing/0.log"
Jul 07 19:25:29.635282 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:29.635197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5966767b69-6jtsc_5e183e89-65fd-4109-af6d-5ea306363aa2/router/0.log"
Jul 07 19:25:29.972891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:29.972865    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-zd9dc_839ef62f-19dd-4d10-a1e1-5a10b007c5a9/main/0.log"
Jul 07 19:25:30.203091 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:30.203063    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-kf8v4_f68079ad-c9be-4c67-8be6-e2549debcff0/main/0.log"
Jul 07 19:25:35.217677 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:35.217621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:35.283989 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:35.283954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log" limit=1024
Jul 07 19:25:38.436292 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:38.436265    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-ckp45_5a2b99a6-1e1c-4212-a3dc-f94f615bffaf/global-pull-secret-syncer/0.log"
Jul 07 19:25:38.496504 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:38.496478    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6gzt2_5d007671-051a-4cae-8609-94302754e98a/konnectivity-agent/0.log"
Jul 07 19:25:38.647133 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:38.647104    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-88.ec2.internal_ad95ec8a8c8db5b9207b4526a1564dff/haproxy/0.log"
Jul 07 19:25:42.844331 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:42.844301    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/extract/0.log"
Jul 07 19:25:42.881076 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:42.881045    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/util/0.log"
Jul 07 19:25:42.944763 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:42.944694    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7594g5qn_c1e568a7-ba9b-48f0-b210-e0b78a0a6627/pull/0.log"
Jul 07 19:25:42.990374 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:42.990344    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/extract/0.log"
Jul 07 19:25:43.022066 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.022039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/util/0.log"
Jul 07 19:25:43.051342 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.051313    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0wdwf7_07ed186a-bccc-4b23-bd98-24e1f355e19c/pull/0.log"
Jul 07 19:25:43.089499 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.089472    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/extract/0.log"
Jul 07 19:25:43.118297 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.118272    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/util/0.log"
Jul 07 19:25:43.146345 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.146313    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73lv67p_974f1e9f-bd89-4a06-8694-02388b9d39d0/pull/0.log"
Jul 07 19:25:43.178553 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.178529    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/extract/0.log"
Jul 07 19:25:43.207747 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.207677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/util/0.log"
Jul 07 19:25:43.230433 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.230410    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1wj9qg_7b64c2f3-2190-4987-849b-bccb97869565/pull/0.log"
Jul 07 19:25:43.554281 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:43.554197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-2lpp5_a1c4fa8e-8bbb-49a2-a824-fff73dc14693/manager/0.log"
Jul 07 19:25:45.658469 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.658438    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/alertmanager/0.log"
Jul 07 19:25:45.688381 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.688355    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/config-reloader/0.log"
Jul 07 19:25:45.719524 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.719429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/kube-rbac-proxy-web/0.log"
Jul 07 19:25:45.763918 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.763887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/kube-rbac-proxy/0.log"
Jul 07 19:25:45.842212 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.842185    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/kube-rbac-proxy-metric/0.log"
Jul 07 19:25:45.892075 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.892050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/prom-label-proxy/0.log"
Jul 07 19:25:45.919739 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:45.919709    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_8ee2ad3a-a5eb-42c3-af5c-ca145df846b1/init-config-reloader/0.log"
Jul 07 19:25:46.092110 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.092020    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5bdd745865-f5kll_f329dc1e-b076-46fa-8bcf-050d1c0fa4a4/metrics-server/0.log"
Jul 07 19:25:46.156035 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.156008    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cckhw_24b17875-f0c0-45f9-968a-9fc9f74dfc86/node-exporter/0.log"
Jul 07 19:25:46.187909 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.187887    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cckhw_24b17875-f0c0-45f9-968a-9fc9f74dfc86/kube-rbac-proxy/0.log"
Jul 07 19:25:46.214486 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.214462    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-cckhw_24b17875-f0c0-45f9-968a-9fc9f74dfc86/init-textfile/0.log"
Jul 07 19:25:46.747086 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.747058    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xqv8z_a5ae47f1-141f-4b51-af58-17bc8aea6b81/prometheus-operator/0.log"
Jul 07 19:25:46.774519 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:46.774494    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-567f7b8b7c-xqv8z_a5ae47f1-141f-4b51-af58-17bc8aea6b81/kube-rbac-proxy/0.log"
Jul 07 19:25:48.036232 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036199    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"]
Jul 07 19:25:48.036689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036618    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy"
Jul 07 19:25:48.036689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036631    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy"
Jul 07 19:25:48.036689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036667    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy"
Jul 07 19:25:48.036689 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036676    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy"
Jul 07 19:25:48.036840 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036742    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy"
Jul 07 19:25:48.036840 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036753    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="bd91e82d-e48d-474a-a983-54c3aedcdbaf" containerName="istio-proxy"
Jul 07 19:25:48.036840 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036763    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c7b625f-f642-4389-99b3-b9280b5c696e" containerName="istio-proxy"
Jul 07 19:25:48.036840 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.036772    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e8c7c8cb-09e6-464c-8645-a64aa39bf87f" containerName="istio-proxy"
Jul 07 19:25:48.039116 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.039100    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.043208 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.043188    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-sls4v\"/\"default-dockercfg-phqzb\""
Jul 07 19:25:48.043319 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.043214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sls4v\"/\"openshift-service-ca.crt\""
Jul 07 19:25:48.043319 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.043215    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-sls4v\"/\"kube-root-ca.crt\""
Jul 07 19:25:48.051324 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.051302    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"]
Jul 07 19:25:48.094707 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.094676    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-podres\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.094866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.094720    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-sys\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.094866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.094738    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m94qg\" (UniqueName: \"kubernetes.io/projected/a321734b-94d8-420d-9927-c50c4b254b2f-kube-api-access-m94qg\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.094866 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.094851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-proc\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.094985 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.094901    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-lib-modules\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.195838 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195806    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-lib-modules\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-podres\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-sys\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m94qg\" (UniqueName: \"kubernetes.io/projected/a321734b-94d8-420d-9927-c50c4b254b2f-kube-api-access-m94qg\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195962    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-sys\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195989    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-podres\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.195989    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-lib-modules\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196030 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.196010    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-proc\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.196302 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.196095    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a321734b-94d8-420d-9927-c50c4b254b2f-proc\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.205986 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.205967    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m94qg\" (UniqueName: \"kubernetes.io/projected/a321734b-94d8-420d-9927-c50c4b254b2f-kube-api-access-m94qg\") pod \"perf-node-gather-daemonset-2wkqn\" (UID: \"a321734b-94d8-420d-9927-c50c4b254b2f\") " pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.349322 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.349235    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:48.497934 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:48.497909    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"]
Jul 07 19:25:48.499346 ip-10-0-141-88 kubenswrapper[2578]: W0707 19:25:48.499319    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda321734b_94d8_420d_9927_c50c4b254b2f.slice/crio-134d1c50213716003eb42de0538d1c9d02a36262f6817222dd025ae3e8fcf040 WatchSource:0}: Error finding container 134d1c50213716003eb42de0538d1c9d02a36262f6817222dd025ae3e8fcf040: Status 404 returned error can't find the container with id 134d1c50213716003eb42de0538d1c9d02a36262f6817222dd025ae3e8fcf040
Jul 07 19:25:49.346430 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:49.346397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn" event={"ID":"a321734b-94d8-420d-9927-c50c4b254b2f","Type":"ContainerStarted","Data":"56b400453c8bd6d216e639518d15c68f9c38bee40c4fb221dc7b58beea5f6220"}
Jul 07 19:25:49.346834 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:49.346445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn" event={"ID":"a321734b-94d8-420d-9927-c50c4b254b2f","Type":"ContainerStarted","Data":"134d1c50213716003eb42de0538d1c9d02a36262f6817222dd025ae3e8fcf040"}
Jul 07 19:25:49.346834 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:49.346525    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:49.367439 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:49.367381    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn" podStartSLOduration=1.3673626890000001 podStartE2EDuration="1.367362689s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 19:25:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 19:25:49.366014233 +0000 UTC m=+2479.782306206" watchObservedRunningTime="2026-07-07 19:25:49.367362689 +0000 UTC m=+2479.783654663"
Jul 07 19:25:49.568792 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:49.568762    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-fc5bcdb7c-p95fc_5766ed8f-be55-4b4a-8375-9abd7f1f6b44/console/0.log"
Jul 07 19:25:51.327295 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:51.327270    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4rjd_0a072962-d98d-4f73-97f2-ee60f69c2f6a/dns/0.log"
Jul 07 19:25:51.357310 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:51.357287    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-n4rjd_0a072962-d98d-4f73-97f2-ee60f69c2f6a/kube-rbac-proxy/0.log"
Jul 07 19:25:51.521070 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:51.521039    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rzzmb_0678dc6a-a5ef-4488-8d21-671bb7048a74/dns-node-resolver/0.log"
Jul 07 19:25:52.095144 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:52.095111    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-574c865c99-gts7t_b1db3896-ac41-4fa4-8f8f-c0a72fd1d1d7/registry/0.log"
Jul 07 19:25:52.151477 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:52.151456    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-h2tpp_623ea161-df1c-46b0-814a-33c155e98c21/node-ca/0.log"
Jul 07 19:25:53.325056 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.325027    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4qmlh_ff4337c5-ff73-4d2c-99a4-798ff7010ca3/discovery/0.log"
Jul 07 19:25:53.379330 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.379304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d58d67c5c-rzhcf_5050efce-31cf-450b-b23d-1536876602c1/kube-auth-proxy/0.log"
Jul 07 19:25:53.412796 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.412772    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/0.log"
Jul 07 19:25:53.439016 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.438989    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/1.log"
Jul 07 19:25:53.477165 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.477142    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qmwhh_b6addf0c-dfad-48e5-b702-b8977049f1d3/payload-pre-processing/0.log"
Jul 07 19:25:53.558892 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:53.558861    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5966767b69-6jtsc_5e183e89-65fd-4109-af6d-5ea306363aa2/router/0.log"
Jul 07 19:25:54.323433 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:54.323404    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sw6rt_47c4802f-90f8-4c0e-a7a0-c72beb7e05e1/serve-healthcheck-canary/0.log"
Jul 07 19:25:54.869096 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:54.869064    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-prf9z_4b9d926f-f9e6-4a08-88cd-4117d8e59f25/insights-operator/0.log"
Jul 07 19:25:54.869547 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:54.869468    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-prf9z_4b9d926f-f9e6-4a08-88cd-4117d8e59f25/insights-operator/1.log"
Jul 07 19:25:55.087348 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:55.087318    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6c4v_a5a4b852-9fb0-429f-8873-d2e5da945d94/kube-rbac-proxy/0.log"
Jul 07 19:25:55.114560 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:55.114538    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6c4v_a5a4b852-9fb0-429f-8873-d2e5da945d94/exporter/0.log"
Jul 07 19:25:55.142295 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:55.142234    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-p6c4v_a5a4b852-9fb0-429f-8873-d2e5da945d94/extractor/0.log"
Jul 07 19:25:55.362185 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:55.362148    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-sls4v/perf-node-gather-daemonset-2wkqn"
Jul 07 19:25:57.623960 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:57.623921    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-mh6rm_6cf269fc-cbc2-4c1a-8a05-d7b5b169a983/manager/0.log"
Jul 07 19:25:57.762200 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:57.762170    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-cmgvd_4a5b14b6-a505-4576-b725-f69047c2bcff/manager/0.log"
Jul 07 19:25:57.805149 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:57.805121    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-74fb8746bf-x2xdx_c4d3e503-8f6f-4445-ac03-b4bd82cceaea/maas-api/0.log"
Jul 07 19:25:57.978315 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:57.978289    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-69fc6dbcbd-5294q_0ffaf4e4-a3d2-48a5-825d-d005c1410d2a/manager/0.log"
Jul 07 19:25:58.001941 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.001913    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-gwsc6_67f37f3e-bba9-4f8c-8bff-c1633913f89e/server/0.log"
Jul 07 19:25:58.073552 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.073527    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-7d74d_264e3a05-34a1-4938-a276-0a9ab162ab99/manager/0.log"
Jul 07 19:25:58.252766 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.252695    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-mhvtj_d52be4d5-67eb-49c8-a6ca-76bca7d7734d/manager/0.log"
Jul 07 19:25:58.277346 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.277320    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-545cccdbd8-mhvtj_d52be4d5-67eb-49c8-a6ca-76bca7d7734d/copy-manifests/0.log"
Jul 07 19:25:58.375564 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.375533    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4qmlh_ff4337c5-ff73-4d2c-99a4-798ff7010ca3/discovery/0.log"
Jul 07 19:25:58.406385 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.406357    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d58d67c5c-rzhcf_5050efce-31cf-450b-b23d-1536876602c1/kube-auth-proxy/0.log"
Jul 07 19:25:58.426437 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.426407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/0.log"
Jul 07 19:25:58.452744 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.452710    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/1.log"
Jul 07 19:25:58.476550 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.474454    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qmwhh_b6addf0c-dfad-48e5-b702-b8977049f1d3/payload-pre-processing/0.log"
Jul 07 19:25:58.526368 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:58.526290    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5966767b69-6jtsc_5e183e89-65fd-4109-af6d-5ea306363aa2/router/0.log"
Jul 07 19:25:59.926123 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:59.926087    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-4qmlh_ff4337c5-ff73-4d2c-99a4-798ff7010ca3/discovery/0.log"
Jul 07 19:25:59.955747 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:59.955714    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-d58d67c5c-rzhcf_5050efce-31cf-450b-b23d-1536876602c1/kube-auth-proxy/0.log"
Jul 07 19:25:59.977891 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:25:59.977866    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/0.log"
Jul 07 19:26:00.005974 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:26:00.005928    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-72bf4_2e5743d8-6fd2-4656-9b9a-c8c32727e894/istio-proxy/1.log"
Jul 07 19:26:00.028461 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:26:00.028432    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-qmwhh_b6addf0c-dfad-48e5-b702-b8977049f1d3/payload-pre-processing/0.log"
Jul 07 19:26:00.091929 ip-10-0-141-88 kubenswrapper[2578]: I0707 19:26:00.091903    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5966767b69-6jtsc_5e183e89-65fd-4109-af6d-5ea306363aa2/router/0.log"