Jul 07 17:40:44.284026 ip-10-0-143-89 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:40:44.731462 ip-10-0-143-89 kubenswrapper[2567]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:44.731462 ip-10-0-143-89 kubenswrapper[2567]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:40:44.731462 ip-10-0-143-89 kubenswrapper[2567]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:44.731462 ip-10-0-143-89 kubenswrapper[2567]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:40:44.731462 ip-10-0-143-89 kubenswrapper[2567]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:40:44.733250 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.733157    2567 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:40:44.740386 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740350    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740404    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740484    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740489    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740492    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740495    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740499    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740501    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740506    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740509    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.740508 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740512    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740516    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740522    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740527    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740531    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740536    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740538    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740541    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740543    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740546    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740549    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740553    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740557    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740560    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740563    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740566    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740569    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740572    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740574    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.740779 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740577    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740579    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740582    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740585    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740589    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740592    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740595    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740597    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740599    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740602    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740604    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740606    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740609    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740612    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740614    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740619    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740622    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740625    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740627    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740630    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.741223 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740633    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740635    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740638    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740641    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740644    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740648    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740652    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740655    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740657    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740660    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740662    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740665    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740674    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740677    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740680    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740682    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740685    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740688    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740690    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.741701 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740693    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740695    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740698    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740701    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740703    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740706    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740708    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740712    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740717    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740734    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740739    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740741    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740744    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740747    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740749    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740753    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740756    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740759    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740761    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740764    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.742165 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740766    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740769    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740771    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740774    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740777    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740779    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740782    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740784    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740787    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740790    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.740792    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741539    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741547    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741550    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741553    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741556    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741559    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741561    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741564    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741566    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.742637 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741569    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741571    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741574    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741577    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741580    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741582    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741585    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741587    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741591    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741593    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741596    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741600    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741604    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741606    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741609    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741611    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741615    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741618    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741620    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741623    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.743129 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741626    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741628    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741631    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741634    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741636    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741639    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741641    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741644    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741646    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741648    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741651    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741653    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741656    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741660    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741663    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741666    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741669    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741671    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741674    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.743621 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741676    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741679    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741689    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741693    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741696    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741699    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741702    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741705    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741709    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741712    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741715    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741718    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741739    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741742    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741745    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741748    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741750    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741753    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741756    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.744094 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741758    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741761    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741763    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741766    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741768    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741771    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741773    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741775    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741778    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741780    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741783    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741785    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741788    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741790    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741792    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741795    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741803    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741806    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741808    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741810    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.744572 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741813    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741816    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741819    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741821    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741824    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741826    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741829    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741831    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741834    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741836    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741838    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.741841    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742268    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742273    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742277    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742280    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742283    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742285    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742288    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742290    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.745091 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742293    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742295    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742298    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742300    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742303    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742306    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742308    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742310    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742318    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742321    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742324    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742326    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742328    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742331    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742334    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742336    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742339    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742341    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742344    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.745575 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742346    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742351    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742354    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742357    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742359    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742361    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742364    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742366    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742369    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742373    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742376    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742379    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742382    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742384    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742387    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742390    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742392    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742394    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742397    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742399    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.746065 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742401    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742404    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742407    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742410    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742413    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742415    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742417    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742420    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742422    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742425    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742427    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742429    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742432    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742435    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742439    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742443    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742445    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742448    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742450    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742453    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.746544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742455    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742457    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742460    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742462    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742466    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742469    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742472    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742474    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742477    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742480    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742483    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742485    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742488    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742490    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742492    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742496    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742499    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742501    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742504    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.747039 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742506    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742510    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742512    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742515    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742517    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742519    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742523    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742525    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742528    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742530    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742533    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742535    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.742537    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742611    2567 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742618    2567 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742627    2567 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742632    2567 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742636    2567 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742639    2567 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742643    2567 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742647    2567 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:40:44.747529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742651    2567 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742653    2567 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742657    2567 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742660    2567 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742663    2567 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742668    2567 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742671    2567 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742675    2567 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742680    2567 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742684    2567 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742691    2567 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742695    2567 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742700    2567 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742705    2567 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742709    2567 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742712    2567 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742715    2567 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742732    2567 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742735    2567 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742739    2567 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742742    2567 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742745    2567 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742748    2567 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742750    2567 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:40:44.748052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742755    2567 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742758    2567 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742761    2567 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742763    2567 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742766    2567 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742770    2567 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742774    2567 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742776    2567 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742779    2567 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742782    2567 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742784    2567 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742788    2567 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742791    2567 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742795    2567 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742798    2567 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742801    2567 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742804    2567 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742807    2567 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742810    2567 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742813    2567 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742816    2567 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742818    2567 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742822    2567 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742825    2567 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742828    2567 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:40:44.748625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742832    2567 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742835    2567 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742838    2567 flags.go:64] FLAG: --help="false"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742841    2567 flags.go:64] FLAG: --hostname-override="ip-10-0-143-89.ec2.internal"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742844    2567 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742846    2567 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742849    2567 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742852    2567 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742855    2567 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742858    2567 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742861    2567 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742864    2567 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742866    2567 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742869    2567 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742872    2567 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742875    2567 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742877    2567 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742880    2567 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742883    2567 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742885    2567 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742890    2567 flags.go:64] FLAG: --lock-file=""
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742892    2567 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742895    2567 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742898    2567 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:40:44.749364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742903    2567 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742907    2567 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742910    2567 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742912    2567 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742915    2567 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742918    2567 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742921    2567 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742924    2567 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742932    2567 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742935    2567 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742939    2567 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742942    2567 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742944    2567 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742947    2567 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742950    2567 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742953    2567 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742956    2567 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742958    2567 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742965    2567 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742968    2567 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742971    2567 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742974    2567 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742976    2567 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:40:44.749970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742982    2567 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742985    2567 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742987    2567 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742990    2567 flags.go:64] FLAG: --port="10250"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742994    2567 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.742997    2567 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-045694f3250933904"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743002    2567 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743004    2567 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743007    2567 flags.go:64] FLAG: --register-node="true"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743010    2567 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743014    2567 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743018    2567 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743020    2567 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743023    2567 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743027    2567 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743030    2567 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743033    2567 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743037    2567 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743040    2567 flags.go:64] FLAG: --runonce="false"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743042    2567 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743045    2567 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743048    2567 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743051    2567 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743054    2567 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743057    2567 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743060    2567 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:40:44.750567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743063    2567 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743066    2567 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743069    2567 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743072    2567 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743074    2567 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743077    2567 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743080    2567 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743083    2567 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743087    2567 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743090    2567 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743093    2567 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743105    2567 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743109    2567 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743112    2567 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743115    2567 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743117    2567 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743121    2567 flags.go:64] FLAG: --v="2"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743129    2567 flags.go:64] FLAG: --version="false"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743134    2567 flags.go:64] FLAG: --vmodule=""
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743138    2567 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743141    2567 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743259    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743263    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743266    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.751236 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743271    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743274    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743277    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743281    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743283    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743286    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743289    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743291    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743294    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743297    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743299    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743302    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743304    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743307    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743310    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743312    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743315    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743317    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743320    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743322    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.751825 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743326    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743328    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743331    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743334    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743336    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743339    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743341    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743344    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743347    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743350    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743352    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743355    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743357    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743359    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743362    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743364    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743366    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743369    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743371    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743374    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.752356 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743376    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743378    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743381    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743383    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743386    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743388    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743391    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743393    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743395    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743398    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743400    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743402    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743406    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743409    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743411    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743414    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743416    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743419    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743421    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743423    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.752859 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743426    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743429    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743431    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743433    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743435    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743438    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743440    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743443    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743445    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743449    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743453    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743456    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743459    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743461    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743464    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743468    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743471    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743474    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743476    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.753334 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743479    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743481    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743484    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743486    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743488    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743494    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743497    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743499    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743502    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743505    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743507    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743510    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743512    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743515    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743518    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743521    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.753801 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.743523    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.743529    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.750488    2567 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.750507    2567 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.751239    2567 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.751250    2567 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751309    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751315    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751319    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751322    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751325    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751328    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751330    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751334    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751337    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.754190 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751340    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751343    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751346    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751348    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751351    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751353    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751356    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751358    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751361    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751363    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751366    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751368    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751371    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751373    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751376    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751379    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751382    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751385    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751387    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751389    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.754602 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751393    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751395    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751398    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751400    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751402    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751405    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751407    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751410    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751414    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751418    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751420    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751423    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751426    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751428    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751431    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751434    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751436    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751438    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751441    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.755114 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751444    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751446    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751449    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751451    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751454    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751457    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751459    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751462    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751464    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751468    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751470    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751472    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751475    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751478    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751481    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751483    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751486    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751489    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751494    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.755574 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751497    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751500    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751503    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751505    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751508    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751510    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751513    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751515    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751517    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751520    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751522    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751524    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751527    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751529    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751532    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751534    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751536    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751539    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751542    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751544    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.756064 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751547    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751549    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751552    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751555    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751557    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751560    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751563    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751565    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751568    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751570    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751572    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751575    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.751580    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751716    2567 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:40:44.756564 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751734    2567 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751737    2567 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751740    2567 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751744    2567 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751746    2567 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751749    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751751    2567 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751754    2567 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751756    2567 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751759    2567 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751761    2567 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751764    2567 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751767    2567 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751769    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751771    2567 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751774    2567 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751777    2567 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751779    2567 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751782    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:40:44.756925 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751784    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751787    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751789    2567 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751792    2567 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751795    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751797    2567 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751800    2567 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751802    2567 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751804    2567 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751807    2567 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751809    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751812    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751814    2567 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751817    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751819    2567 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751822    2567 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751826    2567 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751829    2567 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751832    2567 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751835    2567 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:40:44.757381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751838    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751840    2567 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751842    2567 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751845    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751848    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751851    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751853    2567 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751855    2567 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751858    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751861    2567 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751863    2567 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751866    2567 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751868    2567 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751870    2567 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751872    2567 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751875    2567 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751878    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751880    2567 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751883    2567 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751885    2567 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:40:44.757894 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751888    2567 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751891    2567 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751893    2567 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751896    2567 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751898    2567 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751901    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751903    2567 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751905    2567 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751908    2567 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751910    2567 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751912    2567 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751915    2567 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751917    2567 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751920    2567 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751922    2567 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751924    2567 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751927    2567 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751929    2567 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751933    2567 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:40:44.758383 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751936    2567 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751939    2567 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751942    2567 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751944    2567 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751947    2567 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751949    2567 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751952    2567 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751954    2567 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751957    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751959    2567 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751962    2567 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751965    2567 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751967    2567 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751969    2567 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751972    2567 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751974    2567 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751977    2567 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751979    2567 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751982    2567 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:40:44.758880 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:44.751985    2567 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.751989    2567 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.752112    2567 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.754273    2567 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.755664    2567 server.go:1019] "Starting client certificate rotation"
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.755755    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.755787    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:40:44.759336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.758906    2567 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:40:44.760382 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.760368    2567 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:40:44.770940 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.770917    2567 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:40:44.773154 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.773137    2567 log.go:25] "Validated CRI v1 image API"
Jul 07 17:40:44.774038 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.774008    2567 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:40:44.779540 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.779510    2567 fs.go:135] Filesystem UUIDs: map[02c9249d-a180-469d-b8be-e9f545c356f6:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 d9a8d1a7-bd51-4884-ada9-73a666025fbf:/dev/nvme0n1p4]
Jul 07 17:40:44.779630 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.779539    2567 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:40:44.784120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.783981    2567 manager.go:216] Machine: {Timestamp:2026-07-07 17:40:44.783429394 +0000 UTC m=+0.368963203 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098668 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c949318f29466fffe720c7ee304a9 SystemUUID:ec2c9493-18f2-9466-fffe-720c7ee304a9 BootID:13fa9486-2733-4679-a851-ff3f21b03500 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:2e:44:8c:4d:57 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:2e:44:8c:4d:57 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:cc:fb:87:c4:69 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:40:44.784120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.784093    2567 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:40:44.784281 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.784246    2567 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:40:44.786421 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.786402    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:40:44.787661 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.787625    2567 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:40:44.787887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.787670    2567 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-89.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:40:44.789070 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.789057    2567 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:40:44.789108 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.789073    2567 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:40:44.789108 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.789081    2567 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:40:44.789108 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.789093    2567 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:40:44.790463 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.790451    2567 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:40:44.793776 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793759    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:40:44.793919 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793909    2567 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:40:44.793951 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793943    2567 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:40:44.793978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793954    2567 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:40:44.793978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793969    2567 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:40:44.793978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793979    2567 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:40:44.794076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.793989    2567 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:40:44.794558 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.794542    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:40:44.794611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.794585    2567 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:40:44.798208 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.798187    2567 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:40:44.800216 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.800202    2567 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:40:44.800278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.800233    2567 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:40:44.801535 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801520    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:40:44.801581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801540    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:40:44.801581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801546    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:40:44.801581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801553    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:40:44.801581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801565    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:40:44.801581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801576    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801587    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801594    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801603    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801612    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801625    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:40:44.801746 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.801657    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:40:44.802349 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.802327    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:40:44.802389 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.802352    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:40:44.802455 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.802444    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:40:44.802486 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.802456    2567 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:40:44.804529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.804512    2567 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-89.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:40:44.805827 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.805813    2567 server.go:1268] "Started kubelet"
Jul 07 17:40:44.805881 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.805845    2567 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:40:44.805972 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.805945    2567 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:40:44.806026 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.806005    2567 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:40:44.806822 ip-10-0-143-89 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:40:44.810490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.810469    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpbtv"
Jul 07 17:40:44.810975 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.810815    2567 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:40:44.814590 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.811646    2567 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:40:44.814590 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.814429    2567 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:40:44.818120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.818099    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-fpbtv"
Jul 07 17:40:44.819951 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.819935    2567 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:40:44.820019 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.819955    2567 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:40:44.820062 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.820046    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:44.820587 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820541    2567 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:40:44.820587 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820565    2567 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:40:44.820714 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820590    2567 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:40:44.820714 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820650    2567 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:40:44.820714 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820660    2567 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:40:44.820977 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820951    2567 factory.go:55] Registering systemd factory
Jul 07 17:40:44.820977 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.820970    2567 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:40:44.821204 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821175    2567 factory.go:153] Registering CRI-O factory
Jul 07 17:40:44.821204 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821194    2567 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:40:44.821323 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821306    2567 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:40:44.821367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821330    2567 factory.go:103] Registering Raw factory
Jul 07 17:40:44.821367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821341    2567 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:40:44.821835 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.821818    2567 manager.go:349] Starting recovery of all containers
Jul 07 17:40:44.823652 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.823618    2567 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:40:44.824903 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.823810    2567 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-89.ec2.internal.18c012ba88b8fa73  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-89.ec2.internal,UID:ip-10-0-143-89.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-89.ec2.internal,},FirstTimestamp:2026-07-07 17:40:44.805757555 +0000 UTC m=+0.391291363,LastTimestamp:2026-07-07 17:40:44.805757555 +0000 UTC m=+0.391291363,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-89.ec2.internal,}"
Jul 07 17:40:44.825014 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.824925    2567 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-89.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:40:44.832515 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.832493    2567 manager.go:354] Recovery completed
Jul 07 17:40:44.834221 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.834198    2567 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 07 17:40:44.837281 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.837267    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:44.839526 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.839510    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:44.839582 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.839542    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:44.839582 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.839552    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:44.840087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840072    2567 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:40:44.840087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840083    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:44.840087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840087    2567 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:40:44.840230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840103    2567 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:40:44.840758 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840742    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:44.840815 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840768    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:44.840815 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.840778    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:44.841267 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.841256    2567 policy_none.go:49] "None policy: Start"
Jul 07 17:40:44.841306 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.841272    2567 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:40:44.841306 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.841282    2567 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:40:44.842258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.842248    2567 policy_none.go:47] "Start"
Jul 07 17:40:44.880346 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880325    2567 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:40:44.880447 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.880363    2567 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:40:44.880447 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880376    2567 server.go:87] "Starting device plugin registration server"
Jul 07 17:40:44.880741 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880705    2567 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:40:44.880855 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880739    2567 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:40:44.880915 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880854    2567 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:40:44.880968 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880922    2567 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:40:44.880968 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.880928    2567 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:40:44.881480 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.881462    2567 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:40:44.881560 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.881506    2567 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:44.981242 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.981202    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:44.982380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.982217    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:44.982380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.982254    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:44.982380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.982270    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:44.982380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.982309    2567 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-89.ec2.internal"
Jul 07 17:40:44.987511 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.987486    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:40:44.988869 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.988852    2567 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:40:44.988936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.988898    2567 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:40:44.988936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.988923    2567 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:40:44.989023 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.988967    2567 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:40:44.990260 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.990245    2567 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-89.ec2.internal"
Jul 07 17:40:44.990339 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:44.990268    2567 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-89.ec2.internal\": node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:44.991222 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:44.991206    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:45.032207 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.032179    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:45.089292 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.089255    2567 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"]
Jul 07 17:40:45.089455 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.089347    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:45.091062 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.091041    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:45.091149 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.091074    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:45.091149 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.091086    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:45.092430 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.092417    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:45.092537 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.092519    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.092591 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.092555    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:45.093265 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093246    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:45.093348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093276    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:45.093348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093282    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:45.093348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093292    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:45.093348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093296    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:45.093348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.093306    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:45.094471 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.094458    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.094519 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.094482    2567 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:40:45.095179 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.095162    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:40:45.095278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.095194    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:40:45.095278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.095209    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:40:45.121606 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.121582    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-89.ec2.internal\" not found" node="ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.122344 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.122323    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8eb586876eff2840404d1d6ada06a7c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-89.ec2.internal\" (UID: \"b8eb586876eff2840404d1d6ada06a7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.122422 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.122350    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.122422 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.122368    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.126356 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.126341    2567 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-89.ec2.internal\" not found" node="ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.132973 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.132952    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:45.222550 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222519    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.222550 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222555    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.222813 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222582    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8eb586876eff2840404d1d6ada06a7c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-89.ec2.internal\" (UID: \"b8eb586876eff2840404d1d6ada06a7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.222813 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222608    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.222813 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222621    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/356bacd0210b30ca797399e51921c131-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal\" (UID: \"356bacd0210b30ca797399e51921c131\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.222813 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:45.222631    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b8eb586876eff2840404d1d6ada06a7c-config\") pod \"kube-apiserver-proxy-ip-10-0-143-89.ec2.internal\" (UID: \"b8eb586876eff2840404d1d6ada06a7c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:45.233715 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.233651    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:45.334480 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:45.334442    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:46.816958 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:46.816921    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:46.822141 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:46.822125    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:46.826954 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:46.826937    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:46.927543 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:46.927451    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.028067 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.028026    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.128779 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.128728    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.146939 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.146899    2567 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:40:47.147096 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.147077    2567 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:40:47.216910 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.216822    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:35:46 +0000 UTC" deadline="2027-12-02 18:34:07.506278774 +0000 UTC"
Jul 07 17:40:47.216910 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.216854    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12312h53m20.289430189s"
Jul 07 17:40:47.229754 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.229725    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.330430 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.330399    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.390232 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:47.390192    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod356bacd0210b30ca797399e51921c131.slice/crio-608dc2c566f7e54c4ef59eccc3c9fa073cecae3c25f347adf9e13bd496d79e69 WatchSource:0}: Error finding container 608dc2c566f7e54c4ef59eccc3c9fa073cecae3c25f347adf9e13bd496d79e69: Status 404 returned error can't find the container with id 608dc2c566f7e54c4ef59eccc3c9fa073cecae3c25f347adf9e13bd496d79e69
Jul 07 17:40:47.390532 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:47.390510    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8eb586876eff2840404d1d6ada06a7c.slice/crio-592232892fc38bd5bdf95181380197f9a2a1d1679e57a97fb2a941ac3eed27bb WatchSource:0}: Error finding container 592232892fc38bd5bdf95181380197f9a2a1d1679e57a97fb2a941ac3eed27bb: Status 404 returned error can't find the container with id 592232892fc38bd5bdf95181380197f9a2a1d1679e57a97fb2a941ac3eed27bb
Jul 07 17:40:47.397254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.397232    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:40:47.431512 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.431483    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.532026 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.531961    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.632502 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.632467    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.724414 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.724384    2567 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:47.733327 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:47.733301    2567 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-89.ec2.internal\" not found"
Jul 07 17:40:47.757653 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.757629    2567 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:47.775794 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.775756    2567 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:47.812859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.812794    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:47.823693 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.823672    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:40:47.824752 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.824735    2567 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal"
Jul 07 17:40:47.835345 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:47.835328    2567 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:40:48.187778 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.187674    2567 apiserver.go:52] "Watching apiserver"
Jul 07 17:40:48.198125 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.196987    2567 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:40:48.198125 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.197714    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-lwptt","openshift-network-operator/iptables-alerter-qn6kg","openshift-ovn-kubernetes/ovnkube-node-pb6hm","kube-system/konnectivity-agent-6lkzm","kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss","openshift-dns/node-resolver-sg447","openshift-image-registry/node-ca-dztqc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal","openshift-multus/multus-jlr4n","openshift-multus/network-metrics-daemon-zzw4b","kube-system/global-pull-secret-syncer-bgktw","openshift-cluster-node-tuning-operator/tuned-6km7g","openshift-multus/multus-additional-cni-plugins-24n8r"]
Jul 07 17:40:48.199689 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.199512    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.200884 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.200860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.200994 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.200955    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:48.202603 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.202583    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.202845 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.202829    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.203076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.203060    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xmmjs\""
Jul 07 17:40:48.203285 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.203267    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.205578 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.205556    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.206074 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.205800    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:40:48.206074 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.206010    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:40:48.206074 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.206024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.206074 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.206034    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:40:48.206659 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.206643    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-c7nr6\""
Jul 07 17:40:48.207315 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.206974    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:40:48.207315 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.207177    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.207446 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.207422    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.208477 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.208459    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.208722 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.208706    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-kl6jn\""
Jul 07 17:40:48.208964 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.208945    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:40:48.209211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.209193    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:40:48.209407 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.209388    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-4zfhw\""
Jul 07 17:40:48.210329 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.209730    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:40:48.210329 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.209992    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:40:48.210329 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210125    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.210329 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210246    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:40:48.210555 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210397    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.210643 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210622    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.210801 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:40:48.210898 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210882    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.210954 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.210899    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.211156 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.211133    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4jsc\""
Jul 07 17:40:48.211740 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.211465    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.212963 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.212946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.213295 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.213247    2567 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:40:48.213972 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.213827    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-t4tpc\""
Jul 07 17:40:48.214461 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.214443    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.214637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.214622    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.214841 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.214824    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:40:48.215159 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.215142    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.215415 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.215377    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-4kmsj\""
Jul 07 17:40:48.215628 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.215612    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.216717 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.216550    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:40:48.216893 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.216879    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:40:48.217073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.217060    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-dllg7\""
Jul 07 17:40:48.217255 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.217238    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:40:48.217675 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.217652    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.217830 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.217817    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:48.217937 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.217911    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:48.218048 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.218031    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.218120 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.218098    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:40:48.221255 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.221236    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:40:48.221427 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.221415    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-khgq9\""
Jul 07 17:40:48.222694 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222674    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.222806 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222708    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-netd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.222806 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-serviceca\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.222806 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-host\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-tmp\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222872    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spc4\" (UniqueName: \"kubernetes.io/projected/c879943f-c00a-4a31-9597-e760842ee89a-kube-api-access-4spc4\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222899    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a942f65-0608-4348-8c53-e24d8bdc5b35-tmp-dir\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-konnectivity-ca\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.222962    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysconfig\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223005    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dnk9\" (UniqueName: \"kubernetes.io/projected/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-kube-api-access-9dnk9\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-lib-modules\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.223092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223065    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovn-node-metrics-cert\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223110    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb2d8\" (UniqueName: \"kubernetes.io/projected/357e8fa9-db38-4687-bc06-4cb59eeb698b-kube-api-access-bb2d8\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223163    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-env-overrides\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt4lg\" (UniqueName: \"kubernetes.io/projected/4877bd4f-13d4-4498-9d1f-19bbfc206250-kube-api-access-dt4lg\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223336    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-registration-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223365    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lnj7\" (UniqueName: \"kubernetes.io/projected/0a942f65-0608-4348-8c53-e24d8bdc5b35-kube-api-access-5lnj7\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.223462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223404    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-systemd-units\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223472    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-systemd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223523    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-ovn\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223564    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-node-log\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223610    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223646    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-device-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223667    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-etc-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.223748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223706    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223798    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-host\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223840    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-netns\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223888    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223923    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-sys-fs\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpthk\" (UniqueName: \"kubernetes.io/projected/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kube-api-access-zpthk\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.223968    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-modprobe-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-socket-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224020    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224047    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-os-release\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224075    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-binary-copy\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.224089 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224090    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-kubernetes\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224124    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224139    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-run\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224156    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a942f65-0608-4348-8c53-e24d8bdc5b35-hosts-file\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-log-socket\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224186    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-script-lib\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224209    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cr4q2\" (UniqueName: \"kubernetes.io/projected/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-kube-api-access-cr4q2\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224228    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-conf\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224281    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224369    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-sys\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224414    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-system-cni-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224463    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224486    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-bin\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.224607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.224534    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.232570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232202    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-config\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.232570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232437    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6tb9\" (UniqueName: \"kubernetes.io/projected/24ce3c0a-c64f-4817-8d12-9b0e500226a2-kube-api-access-k6tb9\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.232570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232497    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-kubelet\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.232570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-var-lib-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.232570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232572    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4877bd4f-13d4-4498-9d1f-19bbfc206250-iptables-alerter-script\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232599    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-slash\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232620    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-var-lib-kubelet\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232734    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-etc-tuned\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232784    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4877bd4f-13d4-4498-9d1f-19bbfc206250-host-slash\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-systemd\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232853    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-agent-certs\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.232908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.232882    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cnibin\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.233366 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.233225    2567 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:40:48.250496 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.250474    2567 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-rvrnq"
Jul 07 17:40:48.258716 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.258689    2567 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-rvrnq"
Jul 07 17:40:48.314433 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.314407    2567 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:40:48.333793 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333746    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-var-lib-kubelet\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-multus-certs\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-etc-tuned\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4877bd4f-13d4-4498-9d1f-19bbfc206250-host-slash\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333887    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-systemd\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333903    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-agent-certs\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333926    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cnibin\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333942    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333957    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-netd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.333987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333973    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-serviceca\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.333995    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-host\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-tmp\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spc4\" (UniqueName: \"kubernetes.io/projected/c879943f-c00a-4a31-9597-e760842ee89a-kube-api-access-4spc4\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a942f65-0608-4348-8c53-e24d8bdc5b35-tmp-dir\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334081    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-konnectivity-ca\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334097    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-multus\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334115    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-conf-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334136    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysconfig\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dnk9\" (UniqueName: \"kubernetes.io/projected/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-kube-api-access-9dnk9\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334174    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-cni-binary-copy\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334189    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-lib-modules\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334214    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovn-node-metrics-cert\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb2d8\" (UniqueName: \"kubernetes.io/projected/357e8fa9-db38-4687-bc06-4cb59eeb698b-kube-api-access-bb2d8\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334254    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334274    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-env-overrides\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334300    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.334374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334324    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-netns\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334341    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt4lg\" (UniqueName: \"kubernetes.io/projected/4877bd4f-13d4-4498-9d1f-19bbfc206250-kube-api-access-dt4lg\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334356    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-registration-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334383    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lnj7\" (UniqueName: \"kubernetes.io/projected/0a942f65-0608-4348-8c53-e24d8bdc5b35-kube-api-access-5lnj7\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334401    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-systemd-units\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334425    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-systemd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334457    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-ovn\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334486    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-node-log\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-k8s-cni-cncf-io\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334517    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334546    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-device-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-etc-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334595    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334612    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-host\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334625    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-cnibin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-kubelet\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334656    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-etc-kubernetes\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334672    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-netns\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334686    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334702    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-system-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334718    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-multus-daemon-config\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334745    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-dbus\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334779    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-sys-fs\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334801    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpthk\" (UniqueName: \"kubernetes.io/projected/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kube-api-access-zpthk\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334825    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-modprobe-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334850    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-socket-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334865    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334880    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-os-release\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334896    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-binary-copy\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334916    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-kubernetes\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334940    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334955    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-run\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.334982    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a942f65-0608-4348-8c53-e24d8bdc5b35-hosts-file\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335002    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-log-socket\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.335864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335021    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-socket-dir-parent\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335041    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-hostroot\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335057    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4ttd\" (UniqueName: \"kubernetes.io/projected/5207ef4d-6746-490b-8288-515ce7ecd460-kube-api-access-c4ttd\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335082    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-script-lib\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cr4q2\" (UniqueName: \"kubernetes.io/projected/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-kube-api-access-cr4q2\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335129    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335158    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-conf\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335201    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-kubelet-config\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335218    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-sys\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-system-cni-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335268    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335284    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-bin\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335309    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335325    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-config\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335343    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6tb9\" (UniqueName: \"kubernetes.io/projected/24ce3c0a-c64f-4817-8d12-9b0e500226a2-kube-api-access-k6tb9\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335359    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-kubelet\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.336622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335378    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-var-lib-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335398    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-os-release\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4877bd4f-13d4-4498-9d1f-19bbfc206250-iptables-alerter-script\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335433    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-slash\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-bin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335577    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-var-lib-kubelet\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335727    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-tuning-conf-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335885    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-ovn\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335941    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-systemd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.335986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-node-log\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336048    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-device-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336076    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336089    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-etc-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336080    2567 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336170    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-systemd\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336178    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-registration-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336241    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-sys\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336244    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-systemd-units\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.337374 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336282    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-kubelet\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336317    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-bin\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336363    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-conf\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336363    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336406    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4877bd4f-13d4-4498-9d1f-19bbfc206250-host-slash\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336452    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-etc-selinux\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336490    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-system-cni-dir\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336550    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-env-overrides\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.336997    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337065    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-var-lib-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337123    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-config\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337131    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-netns\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337118    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-host\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337204    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-host\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.337272    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337355    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-serviceca\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337401    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.338210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337442    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0a942f65-0608-4348-8c53-e24d8bdc5b35-hosts-file\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.337448    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:48.837425869 +0000 UTC m=+3.030918842 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337476    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-lib-modules\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337483    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-slash\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337540    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-os-release\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337575    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysconfig\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337623    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-kubernetes\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337676    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovnkube-script-lib\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337690    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cni-binary-copy\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337707    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-sysctl-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337712    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-etc-modprobe-d\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337750    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-run-openvswitch\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337830    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c879943f-c00a-4a31-9597-e760842ee89a-run\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337863    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-cnibin\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337864    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-socket-dir\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337909    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/61378919-faa0-4d2b-b9b8-ea3e1114ffac-sys-fs\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337912    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-log-socket\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-cni-netd\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337943    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/357e8fa9-db38-4687-bc06-4cb59eeb698b-host-run-ovn-kubernetes\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.339731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.337986    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0a942f65-0608-4348-8c53-e24d8bdc5b35-tmp-dir\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.339731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.338248    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4877bd4f-13d4-4498-9d1f-19bbfc206250-iptables-alerter-script\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.339731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.338708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-konnectivity-ca\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.340971 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.340947    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/44a8d9a9-0955-4c09-af83-0ec35fdc3dbb-agent-certs\") pod \"konnectivity-agent-6lkzm\" (UID: \"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb\") " pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.341227 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.341209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-etc-tuned\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.342034 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.342012    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c879943f-c00a-4a31-9597-e760842ee89a-tmp\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.346732 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.346700    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/357e8fa9-db38-4687-bc06-4cb59eeb698b-ovn-node-metrics-cert\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.346846 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.346826    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cr4q2\" (UniqueName: \"kubernetes.io/projected/cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56-kube-api-access-cr4q2\") pod \"node-ca-dztqc\" (UID: \"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56\") " pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.348336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.347609    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb2d8\" (UniqueName: \"kubernetes.io/projected/357e8fa9-db38-4687-bc06-4cb59eeb698b-kube-api-access-bb2d8\") pod \"ovnkube-node-pb6hm\" (UID: \"357e8fa9-db38-4687-bc06-4cb59eeb698b\") " pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.348777 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.348736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lnj7\" (UniqueName: \"kubernetes.io/projected/0a942f65-0608-4348-8c53-e24d8bdc5b35-kube-api-access-5lnj7\") pod \"node-resolver-sg447\" (UID: \"0a942f65-0608-4348-8c53-e24d8bdc5b35\") " pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.349780 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.349736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt4lg\" (UniqueName: \"kubernetes.io/projected/4877bd4f-13d4-4498-9d1f-19bbfc206250-kube-api-access-dt4lg\") pod \"iptables-alerter-qn6kg\" (UID: \"4877bd4f-13d4-4498-9d1f-19bbfc206250\") " pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.353487 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.353467    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6tb9\" (UniqueName: \"kubernetes.io/projected/24ce3c0a-c64f-4817-8d12-9b0e500226a2-kube-api-access-k6tb9\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.354521 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.354495    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dnk9\" (UniqueName: \"kubernetes.io/projected/29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65-kube-api-access-9dnk9\") pod \"multus-additional-cni-plugins-24n8r\" (UID: \"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65\") " pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.355102 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.355080    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpthk\" (UniqueName: \"kubernetes.io/projected/61378919-faa0-4d2b-b9b8-ea3e1114ffac-kube-api-access-zpthk\") pod \"aws-ebs-csi-driver-node-2fdss\" (UID: \"61378919-faa0-4d2b-b9b8-ea3e1114ffac\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.357265 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.357243    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spc4\" (UniqueName: \"kubernetes.io/projected/c879943f-c00a-4a31-9597-e760842ee89a-kube-api-access-4spc4\") pod \"tuned-6km7g\" (UID: \"c879943f-c00a-4a31-9597-e760842ee89a\") " pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.389387 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.389320    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal" event={"ID":"356bacd0210b30ca797399e51921c131","Type":"ContainerStarted","Data":"608dc2c566f7e54c4ef59eccc3c9fa073cecae3c25f347adf9e13bd496d79e69"}
Jul 07 17:40:48.390603 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.390577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal" event={"ID":"b8eb586876eff2840404d1d6ada06a7c","Type":"ContainerStarted","Data":"592232892fc38bd5bdf95181380197f9a2a1d1679e57a97fb2a941ac3eed27bb"}
Jul 07 17:40:48.436020 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.435796    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-os-release\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-bin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436071    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-multus-certs\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.435967    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-os-release\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436102    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-multus\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436123    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-conf-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436142    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-multus-certs\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436147    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-bin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-cni-binary-copy\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:48.436211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436201    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-cni-multus\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436209    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436242    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436259    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-netns\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436293    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-k8s-cni-cncf-io\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436326    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-cnibin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436367    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-kubelet\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436390    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-etc-kubernetes\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436415    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-system-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-multus-daemon-config\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436485    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-cnibin\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436513    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-dbus\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436571    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-socket-dir-parent\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436596    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-hostroot\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436615    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4ttd\" (UniqueName: \"kubernetes.io/projected/5207ef4d-6746-490b-8288-515ce7ecd460-kube-api-access-c4ttd\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436634    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436650    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-kubelet-config\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-kubelet-config\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.436790 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436733    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-conf-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436743    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-cni-binary-copy\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436755    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-netns\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436807    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-run-k8s-cni-cncf-io\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436855    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-multus-socket-dir-parent\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436855    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-host-var-lib-kubelet\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436878    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-system-cni-dir\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.436895    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436903    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-etc-kubernetes\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436924    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/5207ef4d-6746-490b-8288-515ce7ecd460-hostroot\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.436949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-dbus\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.437026    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:40:48.937007566 +0000 UTC m=+3.130500520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:48.437442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.437187    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/5207ef4d-6746-490b-8288-515ce7ecd460-multus-daemon-config\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.442991 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.442926    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:48.442991 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.442952    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:48.442991 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.442967    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:48.443216 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.443040    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:40:48.943026667 +0000 UTC m=+3.136519625 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:48.446433 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.446414    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4ttd\" (UniqueName: \"kubernetes.io/projected/5207ef4d-6746-490b-8288-515ce7ecd460-kube-api-access-c4ttd\") pod \"multus-jlr4n\" (UID: \"5207ef4d-6746-490b-8288-515ce7ecd460\") " pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.516611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.516566    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-sg447"
Jul 07 17:40:48.534891 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.534860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:40:48.543996 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.543971    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-jlr4n"
Jul 07 17:40:48.551847 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.551819    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:40:48.558510 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.558484    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-24n8r"
Jul 07 17:40:48.567474 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.567452    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss"
Jul 07 17:40:48.575180 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.575152    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dztqc"
Jul 07 17:40:48.587890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.587860    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6km7g"
Jul 07 17:40:48.606517 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.606485    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qn6kg"
Jul 07 17:40:48.627949 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.627921    2567 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:40:48.840512 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.840424    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:48.840671 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.840596    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:48.840716 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.840672    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:49.840654218 +0000 UTC m=+4.034147186 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:48.940914 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:48.940879    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:48.941084 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.941059    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:48.941157 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:48.941143    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:40:49.941123711 +0000 UTC m=+4.134616668 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:49.041586 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:49.041543    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:49.041747 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.041694    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:49.041747 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.041716    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:49.041747 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.041727    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:49.041932 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.041822    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:40:50.041792452 +0000 UTC m=+4.235285406 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:49.261869 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:49.261724    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:35:48 +0000 UTC" deadline="2028-03-24 12:11:18.21430744 +0000 UTC"
Jul 07 17:40:49.261869 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:49.261777    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15018h30m28.952549523s"
Jul 07 17:40:49.426180 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.426092    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61378919_faa0_4d2b_b9b8_ea3e1114ffac.slice/crio-26595b8076ca7151debdf56cef1555f6cca00dd594bc21812f526cdea21317c0 WatchSource:0}: Error finding container 26595b8076ca7151debdf56cef1555f6cca00dd594bc21812f526cdea21317c0: Status 404 returned error can't find the container with id 26595b8076ca7151debdf56cef1555f6cca00dd594bc21812f526cdea21317c0
Jul 07 17:40:49.426900 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.426876    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc879943f_c00a_4a31_9597_e760842ee89a.slice/crio-b83382ee0019303aae03fee1c5298b09cd2c35170ee1288df5fdbfa439aee77f WatchSource:0}: Error finding container b83382ee0019303aae03fee1c5298b09cd2c35170ee1288df5fdbfa439aee77f: Status 404 returned error can't find the container with id b83382ee0019303aae03fee1c5298b09cd2c35170ee1288df5fdbfa439aee77f
Jul 07 17:40:49.428185 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.428147    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd13ff0d_7a6f_47dc_bbc8_e80be50b4c56.slice/crio-229b8d13f9a09bee6c0fbec4bda40012567c9514a71165570509d3e269820e0b WatchSource:0}: Error finding container 229b8d13f9a09bee6c0fbec4bda40012567c9514a71165570509d3e269820e0b: Status 404 returned error can't find the container with id 229b8d13f9a09bee6c0fbec4bda40012567c9514a71165570509d3e269820e0b
Jul 07 17:40:49.432852 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.432832    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357e8fa9_db38_4687_bc06_4cb59eeb698b.slice/crio-b108ebf61e93ffcad364b19543fe708f47d4a7dece3c08c3bea662289a6e5be6 WatchSource:0}: Error finding container b108ebf61e93ffcad364b19543fe708f47d4a7dece3c08c3bea662289a6e5be6: Status 404 returned error can't find the container with id b108ebf61e93ffcad364b19543fe708f47d4a7dece3c08c3bea662289a6e5be6
Jul 07 17:40:49.434515 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.434289    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a942f65_0608_4348_8c53_e24d8bdc5b35.slice/crio-ea0f77de4e7ab20d93c36c6602da4d8ec560f1b31758f63c97ebc999a55b3403 WatchSource:0}: Error finding container ea0f77de4e7ab20d93c36c6602da4d8ec560f1b31758f63c97ebc999a55b3403: Status 404 returned error can't find the container with id ea0f77de4e7ab20d93c36c6602da4d8ec560f1b31758f63c97ebc999a55b3403
Jul 07 17:40:49.437640 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.437619    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5207ef4d_6746_490b_8288_515ce7ecd460.slice/crio-67ef8001772ec588fecc741083194106b95d59d624630ded43815e6c41501128 WatchSource:0}: Error finding container 67ef8001772ec588fecc741083194106b95d59d624630ded43815e6c41501128: Status 404 returned error can't find the container with id 67ef8001772ec588fecc741083194106b95d59d624630ded43815e6c41501128
Jul 07 17:40:49.438756 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.438734    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44a8d9a9_0955_4c09_af83_0ec35fdc3dbb.slice/crio-390e4b1abb8c8d191db8ad8465fc3d266d45fa6d3999e3a8fb07528a601c15a6 WatchSource:0}: Error finding container 390e4b1abb8c8d191db8ad8465fc3d266d45fa6d3999e3a8fb07528a601c15a6: Status 404 returned error can't find the container with id 390e4b1abb8c8d191db8ad8465fc3d266d45fa6d3999e3a8fb07528a601c15a6
Jul 07 17:40:49.441794 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:40:49.441750    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4877bd4f_13d4_4498_9d1f_19bbfc206250.slice/crio-34b5ac11961c2e7dbcf49542251576a41a7b3ea2f5891f414f0fda77b11627c1 WatchSource:0}: Error finding container 34b5ac11961c2e7dbcf49542251576a41a7b3ea2f5891f414f0fda77b11627c1: Status 404 returned error can't find the container with id 34b5ac11961c2e7dbcf49542251576a41a7b3ea2f5891f414f0fda77b11627c1
Jul 07 17:40:49.849247 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:49.849154    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:49.849406 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.849317    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:49.849406 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.849391    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:51.849371947 +0000 UTC m=+6.042864903 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:49.950539 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:49.949936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:49.950539 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.950112    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:49.950539 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:49.950177    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:40:51.950157901 +0000 UTC m=+6.143650860 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:50.051834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.051204    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:50.051834 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.051377    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:50.051834 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.051397    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:50.051834 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.051410    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:50.051834 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.051468    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:40:52.051450482 +0000 UTC m=+6.244943442 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:50.262944 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.262798    2567 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:35:48 +0000 UTC" deadline="2028-02-17 14:05:08.019353645 +0000 UTC"
Jul 07 17:40:50.262944 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.262863    2567 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14156h24m17.756494934s"
Jul 07 17:40:50.390560 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.390529    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:50.390737 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.390664    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:40:50.391040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.391022    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:50.391169 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.391112    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:50.391232 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.391214    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:50.391383 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:50.391328    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:50.407376 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.407343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss" event={"ID":"61378919-faa0-4d2b-b9b8-ea3e1114ffac","Type":"ContainerStarted","Data":"26595b8076ca7151debdf56cef1555f6cca00dd594bc21812f526cdea21317c0"}
Jul 07 17:40:50.419797 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.419120    2567 generic.go:356] "Generic (PLEG): container finished" podID="356bacd0210b30ca797399e51921c131" containerID="aa7c34a416b921992a8c4c5dfc16240b12ebc93c524af0efb0b5ac8137785248" exitCode=0
Jul 07 17:40:50.419797 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.419211    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal" event={"ID":"356bacd0210b30ca797399e51921c131","Type":"ContainerDied","Data":"aa7c34a416b921992a8c4c5dfc16240b12ebc93c524af0efb0b5ac8137785248"}
Jul 07 17:40:50.424471 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.423343    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qn6kg" event={"ID":"4877bd4f-13d4-4498-9d1f-19bbfc206250","Type":"ContainerStarted","Data":"34b5ac11961c2e7dbcf49542251576a41a7b3ea2f5891f414f0fda77b11627c1"}
Jul 07 17:40:50.440571 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.440186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlr4n" event={"ID":"5207ef4d-6746-490b-8288-515ce7ecd460","Type":"ContainerStarted","Data":"67ef8001772ec588fecc741083194106b95d59d624630ded43815e6c41501128"}
Jul 07 17:40:50.455607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.455527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerStarted","Data":"9a496098b70a3adcabe687a22dcd9712e8c87a263be57cef139cd9da8662a21e"}
Jul 07 17:40:50.458298 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.458223    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6km7g" event={"ID":"c879943f-c00a-4a31-9597-e760842ee89a","Type":"ContainerStarted","Data":"b83382ee0019303aae03fee1c5298b09cd2c35170ee1288df5fdbfa439aee77f"}
Jul 07 17:40:50.466024 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.465237    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal" event={"ID":"b8eb586876eff2840404d1d6ada06a7c","Type":"ContainerStarted","Data":"afe6fd7f1d1140b7596b05f96fffa8760e40a838258c1448c6c4420b2575e226"}
Jul 07 17:40:50.468125 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.468053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lkzm" event={"ID":"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb","Type":"ContainerStarted","Data":"390e4b1abb8c8d191db8ad8465fc3d266d45fa6d3999e3a8fb07528a601c15a6"}
Jul 07 17:40:50.476839 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.476692    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sg447" event={"ID":"0a942f65-0608-4348-8c53-e24d8bdc5b35","Type":"ContainerStarted","Data":"ea0f77de4e7ab20d93c36c6602da4d8ec560f1b31758f63c97ebc999a55b3403"}
Jul 07 17:40:50.504890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.504850    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"b108ebf61e93ffcad364b19543fe708f47d4a7dece3c08c3bea662289a6e5be6"}
Jul 07 17:40:50.515858 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:50.515749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dztqc" event={"ID":"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56","Type":"ContainerStarted","Data":"229b8d13f9a09bee6c0fbec4bda40012567c9514a71165570509d3e269820e0b"}
Jul 07 17:40:51.536913 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:51.536844    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal" event={"ID":"356bacd0210b30ca797399e51921c131","Type":"ContainerStarted","Data":"4bc1e2ae259864ab3e3a95f30276915437f00976477f7271607a11f45c5f9530"}
Jul 07 17:40:51.555886 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:51.555481    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-89.ec2.internal" podStartSLOduration=4.555456381 podStartE2EDuration="4.555456381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:50.479951116 +0000 UTC m=+4.673444100" watchObservedRunningTime="2026-07-07 17:40:51.555456381 +0000 UTC m=+5.748949359"
Jul 07 17:40:51.869379 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:51.869303    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:51.869531 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:51.869460    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:51.869531 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:51.869518    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:40:55.869502469 +0000 UTC m=+10.062995436 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:51.970517 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:51.969945    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:51.970517 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:51.970089    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:51.970517 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:51.970152    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:40:55.97013291 +0000 UTC m=+10.163625868 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:52.071187 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:52.070530    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:52.071187 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.070728    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:52.071187 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.070748    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:52.071187 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.070776    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:52.071187 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.070835    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:40:56.070817845 +0000 UTC m=+10.264310801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:52.383890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:52.383863    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:52.384084 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.384005    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:52.384207 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:52.384172    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:52.384308 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.384271    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:40:52.384370 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:52.384320    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:52.384420 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:52.384393    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:54.383866 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:54.383758    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:54.384290 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:54.383888    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:54.384290 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:54.383995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:54.384290 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:54.384072    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:40:54.384290 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:54.384125    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:54.384290 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:54.384214    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:55.902205 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:55.902160    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:55.902714 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:55.902353    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:55.902714 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:55.902429    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:03.902408464 +0000 UTC m=+18.095901417 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:40:56.002864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:56.002823    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:56.003030 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.002977    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:56.003074 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.003046    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:04.003031642 +0000 UTC m=+18.196524596 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:40:56.104292 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:56.104244    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:56.104477 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.104423    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:40:56.104477 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.104443    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:40:56.104477 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.104456    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:56.104655 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.104527    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:41:04.104496846 +0000 UTC m=+18.297989803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:40:56.382485 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:56.382398    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:56.382639 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.382529    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:56.382908 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:56.382890    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:56.383012 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.382985    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:56.383137 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:56.383034    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:56.383137 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:56.383109    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:40:58.385598 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:58.385560    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:40:58.386063 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:58.385696    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:40:58.386063 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:58.385932    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:40:58.386063 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:58.386001    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:40:58.386063 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:40:58.386013    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:40:58.386280 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:40:58.386130    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:00.384376 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:00.384296    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:00.384376 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:00.384342    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:00.384882 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:00.384424    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:00.384882 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:00.384447    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:00.384882 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:00.384549    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:00.384882 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:00.384632    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:02.382247 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:02.382199    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:02.382247 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:02.382242    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:02.382645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:02.382198    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:02.382645 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:02.382339    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:02.382645 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:02.382403    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:02.382645 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:02.382464    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:03.966118 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:03.966077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:03.966686 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:03.966254    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:41:03.966686 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:03.966349    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:19.966327474 +0000 UTC m=+34.159820428 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:41:04.067495 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:04.067452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:04.067680 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.067637    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:41:04.067758 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.067726    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:20.0677038 +0000 UTC m=+34.261196755 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:41:04.168911 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:04.168876    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:04.169082 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.169006    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:41:04.169082 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.169023    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:41:04.169082 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.169032    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:41:04.169245 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.169085    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:41:20.16907148 +0000 UTC m=+34.362564436 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:41:04.382030 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:04.381993    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:04.382162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:04.382002    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:04.382162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:04.382121    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:04.382162 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.382125    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:04.382309 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.382207    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:04.382309 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:04.382279    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:06.382367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:06.382293    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:06.382367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:06.382363    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:06.382896 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:06.382339    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:06.382896 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:06.382449    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:06.382896 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:06.382538    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:06.382896 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:06.382608    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:08.381666 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.381448    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:08.382136 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:08.381808    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:08.382136 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.381593    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:08.382136 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:08.381910    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:08.382136 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.381455    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:08.382136 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:08.382002    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:08.573599 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.573158    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-6lkzm" event={"ID":"44a8d9a9-0955-4c09-af83-0ec35fdc3dbb","Type":"ContainerStarted","Data":"84a7a3655de1755f8beb051b6165b9dfcf562e85f268afedd25ae09624c8aa2f"}
Jul 07 17:41:08.574889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.574861    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-sg447" event={"ID":"0a942f65-0608-4348-8c53-e24d8bdc5b35","Type":"ContainerStarted","Data":"ee3b4e22508c15c6b3dc11040e252f9eca82b813ec369bdbcada87cd55a59267"}
Jul 07 17:41:08.576798 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.576627    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"3eb8c2c9d7a09a9cb2d727926836a105c4c0717652c7921481c4776cdf458f45"}
Jul 07 17:41:08.578151 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.578108    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dztqc" event={"ID":"cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56","Type":"ContainerStarted","Data":"efc9f7eaeddf8b67486620bd4f888d6c93769b79c4ea21b8cb09f7b809d79ad1"}
Jul 07 17:41:08.579389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.579370    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss" event={"ID":"61378919-faa0-4d2b-b9b8-ea3e1114ffac","Type":"ContainerStarted","Data":"e685fc47fc737f1b31000360ae1c4a66adafb10a63a18fe774f8a25164385528"}
Jul 07 17:41:08.581127 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.580775    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-jlr4n" event={"ID":"5207ef4d-6746-490b-8288-515ce7ecd460","Type":"ContainerStarted","Data":"04ac1cf894010f42f9b96d2ce43573cef0a273e7fe125a7e45190c068ea26f13"}
Jul 07 17:41:08.582082 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.582045    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerStarted","Data":"ddc2257bbbd869d71eba181f08dcc554006e196f70bdaab4021158330a2e5e63"}
Jul 07 17:41:08.583505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.583448    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6km7g" event={"ID":"c879943f-c00a-4a31-9597-e760842ee89a","Type":"ContainerStarted","Data":"7c9af9a47dbe6a6c4290e1c4779bc4daab7d773a36697c4708e73dbfab08137f"}
Jul 07 17:41:08.593398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.593351    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-89.ec2.internal" podStartSLOduration=21.593337428 podStartE2EDuration="21.593337428s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:40:51.554708482 +0000 UTC m=+5.748201471" watchObservedRunningTime="2026-07-07 17:41:08.593337428 +0000 UTC m=+22.786830459"
Jul 07 17:41:08.613648 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.613592    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-6lkzm" podStartSLOduration=7.66613104 podStartE2EDuration="22.613575775s" totalImagesPullingTime="14.947444735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:08.593273005 +0000 UTC m=+22.786765981" watchObservedRunningTime="2026-07-07 17:41:08.613575775 +0000 UTC m=+22.807068750"
Jul 07 17:41:08.627665 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.627533    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dztqc" podStartSLOduration=3.8422263279999997 podStartE2EDuration="22.627515946s" totalImagesPullingTime="18.785289618s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:08.626921844 +0000 UTC m=+22.820414822" watchObservedRunningTime="2026-07-07 17:41:08.627515946 +0000 UTC m=+22.821008921"
Jul 07 17:41:08.644064 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.644002    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6km7g" podStartSLOduration=3.78622003 podStartE2EDuration="22.643976956s" totalImagesPullingTime="18.857756926s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:08.643593479 +0000 UTC m=+22.837086455" watchObservedRunningTime="2026-07-07 17:41:08.643976956 +0000 UTC m=+22.837469944"
Jul 07 17:41:08.664539 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.664477    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-jlr4n" podStartSLOduration=3.706690374 podStartE2EDuration="22.664454358s" totalImagesPullingTime="18.957763984s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:08.663842183 +0000 UTC m=+22.857335184" watchObservedRunningTime="2026-07-07 17:41:08.664454358 +0000 UTC m=+22.857947335"
Jul 07 17:41:08.718928 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.718723    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:08.785668 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.785638    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:08.889678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:08.889653    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:09.588261 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588239    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588614    2567 generic.go:356] "Generic (PLEG): container finished" podID="357e8fa9-db38-4687-bc06-4cb59eeb698b" containerID="33483d2fa43ae627a63f23959be0b6a8fac4f19bdc3c32a95d6789cf1f760d30" exitCode=1
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588693    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"246ad5a61d5291c338d2319daf87c545401b0a32d056477e486431c3405c7468"}
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588787    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"14ec6c712d23e62a4cd474cce926ab5dfb64b7a76f72f7558f72775b2a3575f1"}
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588836    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"d6712b17ae8156ada3e9e64e8c50b2bd3b7e24c45c9f9f498490bcd925636d54"}
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588865    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"f04cdd914985a291d7481a281758c75ba4dd41bbc51c772e1b76c1ff2c535658"}
Jul 07 17:41:09.588983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.588894    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerDied","Data":"33483d2fa43ae627a63f23959be0b6a8fac4f19bdc3c32a95d6789cf1f760d30"}
Jul 07 17:41:09.590211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.590191    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="ddc2257bbbd869d71eba181f08dcc554006e196f70bdaab4021158330a2e5e63" exitCode=0
Jul 07 17:41:09.590331 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.590309    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"ddc2257bbbd869d71eba181f08dcc554006e196f70bdaab4021158330a2e5e63"}
Jul 07 17:41:09.628017 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:09.627946    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-sg447" podStartSLOduration=4.773154745 podStartE2EDuration="23.627930805s" totalImagesPullingTime="18.85477606s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:09.62762647 +0000 UTC m=+23.821119445" watchObservedRunningTime="2026-07-07 17:41:09.627930805 +0000 UTC m=+23.821423780"
Jul 07 17:41:10.112252 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.111997    2567 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:41:10.286560 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.286418    2567 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:41:10.112248873Z","UUID":"52b89101-40d3-4c4a-bfb1-ee1084587a07","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:41:10.288086 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.288062    2567 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:41:10.288208 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.288107    2567 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:41:10.382388 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.382307    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:10.382388 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.382367    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:10.382640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.382374    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:10.382640 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:10.382468    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:10.382740 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:10.382637    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:10.382835 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:10.382742    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:10.591275 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.591237    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:41:10.591887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.591864    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:41:10.594820 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.594752    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qn6kg" event={"ID":"4877bd4f-13d4-4498-9d1f-19bbfc206250","Type":"ContainerStarted","Data":"d65425ff580d2e9c7c034be19f3252694d450c098d213867454844bf6bad1f2e"}
Jul 07 17:41:10.597011 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.596987    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss" event={"ID":"61378919-faa0-4d2b-b9b8-ea3e1114ffac","Type":"ContainerStarted","Data":"cf729ea40dc9763d0081b23acfb3620224670512c684ccb553151da82f6be097"}
Jul 07 17:41:10.597210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.597196    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:41:10.597715 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.597699    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-6lkzm"
Jul 07 17:41:10.621031 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.620972    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qn6kg" podStartSLOduration=5.775228011 podStartE2EDuration="24.620956s" totalImagesPullingTime="18.845727989s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:10.620748207 +0000 UTC m=+24.814241183" watchObservedRunningTime="2026-07-07 17:41:10.620956 +0000 UTC m=+24.814448975"
Jul 07 17:41:10.740116 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.740090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:10.842517 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.842471    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:10.943144 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:10.943095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:11.043234 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:11.043146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:11.603288 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:11.603261    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:41:11.603899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:11.603695    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"94542a081322a6719e912710efaa59cbc6a5c7ecfe4fae4f51f9edc0ee3e0715"}
Jul 07 17:41:11.606270 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:11.606236    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss" event={"ID":"61378919-faa0-4d2b-b9b8-ea3e1114ffac","Type":"ContainerStarted","Data":"7efee0c5f5ee4cc97e531ee88d0c1c668d02567b13acbd1f0aa2714c5d84e2f2"}
Jul 07 17:41:11.627130 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:11.627088    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2fdss" podStartSLOduration=4.092963602 podStartE2EDuration="25.627073796s" totalImagesPullingTime="21.534110194s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:11.626427776 +0000 UTC m=+25.819920763" watchObservedRunningTime="2026-07-07 17:41:11.627073796 +0000 UTC m=+25.820566771"
Jul 07 17:41:12.382204 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:12.382167    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:12.382459 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:12.382219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:12.382459 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:12.382168    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:12.382459 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:12.382302    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:12.382459 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:12.382434    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:12.382626 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:12.382575    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:13.870690 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:13.870474    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:13.975428 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:13.975390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:14.075420 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.075385    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:14.381929 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.381850    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:14.381929 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.381882    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:14.382161 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.381851    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:14.382161 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:14.381953    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:14.382161 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:14.382060    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:14.382266 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:14.382158    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:14.614687 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.614652    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="80f5b1a65402af16a06d83e7e17dfb18cb1c1cf3bb34af073344d990be139b0d" exitCode=0
Jul 07 17:41:14.614899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.614736    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"80f5b1a65402af16a06d83e7e17dfb18cb1c1cf3bb34af073344d990be139b0d"}
Jul 07 17:41:14.621645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.621624    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:41:14.622045 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.622024    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"7bd37f114569d859c4ac61d9b255ae4341f942488df8bce5e92419578d410a25"}
Jul 07 17:41:14.622296 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.622275    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:14.622414 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.622336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:14.622471 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.622453    2567 scope.go:117] "RemoveContainer" containerID="33483d2fa43ae627a63f23959be0b6a8fac4f19bdc3c32a95d6789cf1f760d30"
Jul 07 17:41:14.639406 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:14.639379    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:15.627476 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.627313    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:41:15.627883 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.627827    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" event={"ID":"357e8fa9-db38-4687-bc06-4cb59eeb698b","Type":"ContainerStarted","Data":"1392ab28614080c78bd35e2ae7a0565ab7987efdeefa885e3e6f735559a19fd1"}
Jul 07 17:41:15.628029 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.628015    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:15.644656 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.644632    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:15.656672 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.656629    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm" podStartSLOduration=10.719347463 podStartE2EDuration="29.65661216s" totalImagesPullingTime="18.937264697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:15.65503039 +0000 UTC m=+29.848523367" watchObservedRunningTime="2026-07-07 17:41:15.65661216 +0000 UTC m=+29.850105136"
Jul 07 17:41:15.804484 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.804457    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgktw"]
Jul 07 17:41:15.804613 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.804601    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:15.804731 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:15.804713    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:15.807671 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.807647    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lwptt"]
Jul 07 17:41:15.807822 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.807800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:15.807935 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:15.807908    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:15.808326 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.808306    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzw4b"]
Jul 07 17:41:15.808424 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:15.808410    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:15.808522 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:15.808503    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:16.632206 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:16.632174    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="41d2de303fc801fb76f8f22204ad7f39045aa13dd625bc2999bf7d8a6464fcfa" exitCode=0
Jul 07 17:41:16.633056 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:16.632254    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"41d2de303fc801fb76f8f22204ad7f39045aa13dd625bc2999bf7d8a6464fcfa"}
Jul 07 17:41:17.381828 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:17.381806    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:17.381955 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:17.381839    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:17.381955 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:17.381839    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:17.381955 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:17.381923    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:17.382100 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:17.381998    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:17.382100 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:17.382090    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:18.640526 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:18.640493    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="3cd23176443fb34b9aef39534927a8c39998fb5b3436adac450b001a8d90c13d" exitCode=0
Jul 07 17:41:18.641017 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:18.640551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"3cd23176443fb34b9aef39534927a8c39998fb5b3436adac450b001a8d90c13d"}
Jul 07 17:41:19.381678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:19.381490    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:19.381877 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:19.381515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:19.381877 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:19.381775    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-zzw4b" podUID="24ce3c0a-c64f-4817-8d12-9b0e500226a2"
Jul 07 17:41:19.381877 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:19.381518    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:19.381877 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:19.381838    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-lwptt" podUID="a5c6e776-171d-4291-822d-bf8cbee652df"
Jul 07 17:41:19.382048 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:19.381917    2567 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bgktw" podUID="f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f"
Jul 07 17:41:19.991405 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:19.991368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:19.991894 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:19.991534    2567 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:41:19.991894 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:19.991604    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs podName:24ce3c0a-c64f-4817-8d12-9b0e500226a2 nodeName:}" failed. No retries permitted until 2026-07-07 17:41:51.991583656 +0000 UTC m=+66.185076612 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs") pod "network-metrics-daemon-zzw4b" (UID: "24ce3c0a-c64f-4817-8d12-9b0e500226a2") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:41:20.092890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:20.092798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:20.093062 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.092939    2567 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:41:20.093062 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.093015    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret podName:f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:52.092995251 +0000 UTC m=+66.286488228 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret") pod "global-pull-secret-syncer-bgktw" (UID: "f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:41:20.193627 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:20.193585    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:20.193800 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.193723    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:41:20.193800 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.193749    2567 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:41:20.193800 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.193776    2567 projected.go:196] Error preparing data for projected volume kube-api-access-9dvsb for pod openshift-network-diagnostics/network-check-target-lwptt: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:41:20.193908 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:20.193831    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb podName:a5c6e776-171d-4291-822d-bf8cbee652df nodeName:}" failed. No retries permitted until 2026-07-07 17:41:52.193815722 +0000 UTC m=+66.387308676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9dvsb" (UniqueName: "kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb") pod "network-check-target-lwptt" (UID: "a5c6e776-171d-4291-822d-bf8cbee652df") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:41:20.442887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:20.442853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:20.509660 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:20.509623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:21.136280 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.136255    2567 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-89.ec2.internal" event="NodeReady"
Jul 07 17:41:21.136719 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.136397    2567 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:41:21.183010 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.182971    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-w8v7h"]
Jul 07 17:41:21.186062 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.185635    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.186290 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.186270    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9nwpp"]
Jul 07 17:41:21.188085 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.188057    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.189091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.188814    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:41:21.189091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.188859    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:41:21.189091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.188865    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gg8rv\""
Jul 07 17:41:21.190606 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.190589    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:41:21.191009 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.190992    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:41:21.191178 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.191162    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:41:21.191249 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.191193    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-l7zp2\""
Jul 07 17:41:21.197093 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.197069    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8v7h"]
Jul 07 17:41:21.200264 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.200241    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nwpp"]
Jul 07 17:41:21.302397 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302359    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-config-volume\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.302569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302400    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d927f87-d697-4ab2-97a0-5874af688f85-cert\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.302569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-tmp-dir\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.302569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302479    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdb9h\" (UniqueName: \"kubernetes.io/projected/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-kube-api-access-hdb9h\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.302569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302530    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.302569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.302571    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whc9f\" (UniqueName: \"kubernetes.io/projected/3d927f87-d697-4ab2-97a0-5874af688f85-kube-api-access-whc9f\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.337151 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.337115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:21.382142 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.382111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:21.382318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.382111    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:21.382318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.382248    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:21.384757 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.384734    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:41:21.384960 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.384918    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njwcl\""
Jul 07 17:41:21.385058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.384983    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92crh\""
Jul 07 17:41:21.385058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.384990    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:41:21.385058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.385003    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:41:21.385058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.385022    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:41:21.402931 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.402904    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-config-volume\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.403051 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.402936    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d927f87-d697-4ab2-97a0-5874af688f85-cert\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.403051 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.402963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-tmp-dir\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.403051 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.402979    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdb9h\" (UniqueName: \"kubernetes.io/projected/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-kube-api-access-hdb9h\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.403214 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.403175    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.403266 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.403234    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whc9f\" (UniqueName: \"kubernetes.io/projected/3d927f87-d697-4ab2-97a0-5874af688f85-kube-api-access-whc9f\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.403346 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.403325    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-tmp-dir\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.403403 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:21.403330    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:21.403461 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:21.403406    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls podName:8d45c4ac-52f1-437e-ac8f-0ad7178ebdce nodeName:}" failed. No retries permitted until 2026-07-07 17:41:21.903389686 +0000 UTC m=+36.096882639 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls") pod "dns-default-w8v7h" (UID: "8d45c4ac-52f1-437e-ac8f-0ad7178ebdce") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:21.403552 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.403534    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-config-volume\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.407277 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.407261    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3d927f87-d697-4ab2-97a0-5874af688f85-cert\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.414843 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.414818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdb9h\" (UniqueName: \"kubernetes.io/projected/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-kube-api-access-hdb9h\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.415062 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.415041    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whc9f\" (UniqueName: \"kubernetes.io/projected/3d927f87-d697-4ab2-97a0-5874af688f85-kube-api-access-whc9f\") pod \"ingress-canary-9nwpp\" (UID: \"3d927f87-d697-4ab2-97a0-5874af688f85\") " pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.437289 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.437252    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:21.505527 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.505435    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9nwpp"
Jul 07 17:41:21.668486 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.667890    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9nwpp"]
Jul 07 17:41:21.673940 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:21.673911    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d927f87_d697_4ab2_97a0_5874af688f85.slice/crio-28b197e2c9d83e0717958af0cba6501ed12355ef9a86290d17322b28916c1ec6 WatchSource:0}: Error finding container 28b197e2c9d83e0717958af0cba6501ed12355ef9a86290d17322b28916c1ec6: Status 404 returned error can't find the container with id 28b197e2c9d83e0717958af0cba6501ed12355ef9a86290d17322b28916c1ec6
Jul 07 17:41:21.907422 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:21.907342    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:21.907566 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:21.907482    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:21.907619 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:21.907567    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls podName:8d45c4ac-52f1-437e-ac8f-0ad7178ebdce nodeName:}" failed. No retries permitted until 2026-07-07 17:41:22.907545945 +0000 UTC m=+37.101038902 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls") pod "dns-default-w8v7h" (UID: "8d45c4ac-52f1-437e-ac8f-0ad7178ebdce") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:22.650663 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:22.650621    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nwpp" event={"ID":"3d927f87-d697-4ab2-97a0-5874af688f85","Type":"ContainerStarted","Data":"28b197e2c9d83e0717958af0cba6501ed12355ef9a86290d17322b28916c1ec6"}
Jul 07 17:41:22.917615 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:22.917577    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:22.917811 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:22.917738    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:22.917872 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:22.917828    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls podName:8d45c4ac-52f1-437e-ac8f-0ad7178ebdce nodeName:}" failed. No retries permitted until 2026-07-07 17:41:24.917809717 +0000 UTC m=+39.111302674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls") pod "dns-default-w8v7h" (UID: "8d45c4ac-52f1-437e-ac8f-0ad7178ebdce") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:24.862668 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.862419    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"]
Jul 07 17:41:24.867820 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.867786    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:24.870288 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.870258    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 07 17:41:24.870432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.870377    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 07 17:41:24.870432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.870405    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:41:24.870531 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.870439    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 07 17:41:24.871425 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.871403    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-x7nm8\""
Jul 07 17:41:24.876517 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.876205    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"]
Jul 07 17:41:24.936972 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.936935    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:24.937129 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:24.937108    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:24.937185 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:24.937175    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls podName:8d45c4ac-52f1-437e-ac8f-0ad7178ebdce nodeName:}" failed. No retries permitted until 2026-07-07 17:41:28.937159011 +0000 UTC m=+43.130651964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls") pod "dns-default-w8v7h" (UID: "8d45c4ac-52f1-437e-ac8f-0ad7178ebdce") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:24.981158 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.981127    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:41:24.989985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.989957    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:24.992950 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.992926    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ktw2w\""
Jul 07 17:41:24.993278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.993236    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 07 17:41:24.993642 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.993620    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 07 17:41:24.994170 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.994157    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 07 17:41:24.998485 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.998394    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 07 17:41:24.999939 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:24.999917    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:41:25.037836 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.037808    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv6q7\" (UniqueName: \"kubernetes.io/projected/75c1628a-45af-43d3-8441-aab9d31d2a00-kube-api-access-rv6q7\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.037960 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.037925    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c1628a-45af-43d3-8441-aab9d31d2a00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.037960 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.037950    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c1628a-45af-43d3-8441-aab9d31d2a00-config\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.132191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.132125    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:25.138576 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138551    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv6q7\" (UniqueName: \"kubernetes.io/projected/75c1628a-45af-43d3-8441-aab9d31d2a00-kube-api-access-rv6q7\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.138684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138586    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138613    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pwnv\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138633    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138669    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138701    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138719    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138736    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.138871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138789    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.139035 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138873    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c1628a-45af-43d3-8441-aab9d31d2a00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.139035 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.138889    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c1628a-45af-43d3-8441-aab9d31d2a00-config\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.139428 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.139412    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/75c1628a-45af-43d3-8441-aab9d31d2a00-config\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.142561 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.142538    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/75c1628a-45af-43d3-8441-aab9d31d2a00-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.147953 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.147926    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv6q7\" (UniqueName: \"kubernetes.io/projected/75c1628a-45af-43d3-8441-aab9d31d2a00-kube-api-access-rv6q7\") pod \"service-ca-operator-5d46d9ffd4-hn9f7\" (UID: \"75c1628a-45af-43d3-8441-aab9d31d2a00\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.180132 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.180099    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"
Jul 07 17:41:25.189339 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.189301    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239227    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239427    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pwnv\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239456    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239484    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239549    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.239576    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.240390    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.240570    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.240587    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78fb494dd6-ksrq6: secret "image-registry-tls" not found
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.240646    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls podName:06492315-6039-46b0-b25b-1f4df856078f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:25.740624744 +0000 UTC m=+39.934117702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls") pod "image-registry-78fb494dd6-ksrq6" (UID: "06492315-6039-46b0-b25b-1f4df856078f") : secret "image-registry-tls" not found
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.241169    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.241581 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.241371    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.243455 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.243435    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.243910 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.243889    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.251690 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.251645    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pwnv\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.252014 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.251991    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.331668 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.331633    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7"]
Jul 07 17:41:25.335471 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:25.335171    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75c1628a_45af_43d3_8441_aab9d31d2a00.slice/crio-5b5bce7e3da959a4754f8444790eb3f780f63b82426a7e24ebc56b5bacf55b83 WatchSource:0}: Error finding container 5b5bce7e3da959a4754f8444790eb3f780f63b82426a7e24ebc56b5bacf55b83: Status 404 returned error can't find the container with id 5b5bce7e3da959a4754f8444790eb3f780f63b82426a7e24ebc56b5bacf55b83
Jul 07 17:41:25.659482 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.659365    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="ab63f2690d2e025375b0c7de2f621eda3ec6056d4bdecd29dcb1ab2d9bc772e6" exitCode=0
Jul 07 17:41:25.659482 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.659444    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"ab63f2690d2e025375b0c7de2f621eda3ec6056d4bdecd29dcb1ab2d9bc772e6"}
Jul 07 17:41:25.660898 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.660876    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9nwpp" event={"ID":"3d927f87-d697-4ab2-97a0-5874af688f85","Type":"ContainerStarted","Data":"592a3c4851ab7129f2bc4484efad95a5d90f7b08f576daaaf10db5b83ff26dcb"}
Jul 07 17:41:25.661947 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.661927    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7" event={"ID":"75c1628a-45af-43d3-8441-aab9d31d2a00","Type":"ContainerStarted","Data":"5b5bce7e3da959a4754f8444790eb3f780f63b82426a7e24ebc56b5bacf55b83"}
Jul 07 17:41:25.700054 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.700011    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9nwpp" podStartSLOduration=1.354815299 podStartE2EDuration="4.69999546s" totalImagesPullingTime="3.345180161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:25.699528744 +0000 UTC m=+39.893021722" watchObservedRunningTime="2026-07-07 17:41:25.69999546 +0000 UTC m=+39.893488435"
Jul 07 17:41:25.745279 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:25.745236    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:25.745494 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.745475    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:25.745553 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.745498    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78fb494dd6-ksrq6: secret "image-registry-tls" not found
Jul 07 17:41:25.745610 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:25.745566    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls podName:06492315-6039-46b0-b25b-1f4df856078f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:26.745546338 +0000 UTC m=+40.939039308 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls") pod "image-registry-78fb494dd6-ksrq6" (UID: "06492315-6039-46b0-b25b-1f4df856078f") : secret "image-registry-tls" not found
Jul 07 17:41:26.558613 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:26.558576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.660553 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:26.660520    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.667872 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:26.667837    2567 generic.go:356] "Generic (PLEG): container finished" podID="29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65" containerID="d866935e56fd2495ba9a00590a6f11bbb1c47b26673ccd91f1b986ec3ad6471d" exitCode=0
Jul 07 17:41:26.668018 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:26.667919    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerDied","Data":"d866935e56fd2495ba9a00590a6f11bbb1c47b26673ccd91f1b986ec3ad6471d"}
Jul 07 17:41:26.752781 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:26.752730    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:26.752967 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:26.752919    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:26.752967 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:26.752941    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78fb494dd6-ksrq6: secret "image-registry-tls" not found
Jul 07 17:41:26.753074 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:26.753009    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls podName:06492315-6039-46b0-b25b-1f4df856078f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:28.752986575 +0000 UTC m=+42.946479545 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls") pod "image-registry-78fb494dd6-ksrq6" (UID: "06492315-6039-46b0-b25b-1f4df856078f") : secret "image-registry-tls" not found
Jul 07 17:41:27.150373 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.150334    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.209228 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.209197    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.674115 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.674078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-24n8r" event={"ID":"29b9ad4b-bf4f-466c-bcc7-a6ff9d332b65","Type":"ContainerStarted","Data":"c8445e00aaa00683f122ef0e4c3124f0ca5678ddd31e6061e8c4c7700b237fcf"}
Jul 07 17:41:27.699961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.699912    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-24n8r" podStartSLOduration=9.994469114 podStartE2EDuration="41.699895692s" totalImagesPullingTime="31.705426578s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:27.699380745 +0000 UTC m=+41.892873720" watchObservedRunningTime="2026-07-07 17:41:27.699895692 +0000 UTC m=+41.893388683"
Jul 07 17:41:27.825373 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.825338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.926020 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:27.925948    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.414988 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.414956    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.473966 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.473940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.677957 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.677866    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7" event={"ID":"75c1628a-45af-43d3-8441-aab9d31d2a00","Type":"ContainerStarted","Data":"41134713c4de36539fbff17bc5057ce13ae8673d9583454cb1ecc0b1f1305e5e"}
Jul 07 17:41:28.771489 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.771257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:28.771489 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:28.771366    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:28.771489 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:28.771392    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78fb494dd6-ksrq6: secret "image-registry-tls" not found
Jul 07 17:41:28.771489 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:28.771465    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls podName:06492315-6039-46b0-b25b-1f4df856078f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:32.771442281 +0000 UTC m=+46.964935249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls") pod "image-registry-78fb494dd6-ksrq6" (UID: "06492315-6039-46b0-b25b-1f4df856078f") : secret "image-registry-tls" not found
Jul 07 17:41:28.806184 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.806147    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.880682 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.880644    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:28.973642 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.973544    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:28.973829 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:28.973703    2567 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:41:28.973829 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:28.973791    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls podName:8d45c4ac-52f1-437e-ac8f-0ad7178ebdce nodeName:}" failed. No retries permitted until 2026-07-07 17:41:36.973752405 +0000 UTC m=+51.167245359 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls") pod "dns-default-w8v7h" (UID: "8d45c4ac-52f1-437e-ac8f-0ad7178ebdce") : secret "dns-default-metrics-tls" not found
Jul 07 17:41:28.989644 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:28.989610    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.088058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.088025    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.464101 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.464064    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.570978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.570946    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.811880 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.811784    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7" podStartSLOduration=3.380244382 podStartE2EDuration="5.811745735s" totalImagesPullingTime="2.431501353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:28.702183199 +0000 UTC m=+42.895676174" watchObservedRunningTime="2026-07-07 17:41:29.811745735 +0000 UTC m=+44.005238705"
Jul 07 17:41:29.812230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.811954    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sllsj"]
Jul 07 17:41:29.832199 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.832172    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sllsj"]
Jul 07 17:41:29.832326 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.832288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.835011 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.834984    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:41:29.835217 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.835198    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:41:29.835304 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.835232    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:41:29.835720 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.835705    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:41:29.835834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.835818    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6sssg\""
Jul 07 17:41:29.863736 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.863710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.879977 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.879949    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317afbee-08a6-4031-aaf6-10aa095ee97e-crio-socket\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.880097 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.879983    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8dnb\" (UniqueName: \"kubernetes.io/projected/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-api-access-v8dnb\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.880097 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.880076    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.880177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.880103    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.880177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.880122    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317afbee-08a6-4031-aaf6-10aa095ee97e-data-volume\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.942256 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.942223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:29.980829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.980793    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317afbee-08a6-4031-aaf6-10aa095ee97e-crio-socket\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.980924 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.980834    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8dnb\" (UniqueName: \"kubernetes.io/projected/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-api-access-v8dnb\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.980924 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.980915    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.980995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.980932    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.981029 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:29.980990    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:29.981029 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:29.981011    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:29.981103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.981032    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317afbee-08a6-4031-aaf6-10aa095ee97e-data-volume\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.981103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.980990    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/317afbee-08a6-4031-aaf6-10aa095ee97e-crio-socket\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.981103 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:29.981070    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:30.481049542 +0000 UTC m=+44.674542520 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:29.981103 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:29.981096    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:30.481086402 +0000 UTC m=+44.674579356 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:29.981307 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.981291    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/317afbee-08a6-4031-aaf6-10aa095ee97e-data-volume\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:29.992465 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:29.992440    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8dnb\" (UniqueName: \"kubernetes.io/projected/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-api-access-v8dnb\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:30.485152 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:30.485108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:30.485152 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:30.485151    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:30.485363 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:30.485241    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:30.485363 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:30.485247    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.485363 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:30.485307    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:31.485294599 +0000 UTC m=+45.678787552 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:30.485363 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:30.485320    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:31.485313584 +0000 UTC m=+45.678806539 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:31.027392 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.027361    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.104798 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.104745    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.128467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.128435    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tjpll"]
Jul 07 17:41:31.146287 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.146262    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tjpll"]
Jul 07 17:41:31.146433 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.146372    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.148998 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.148977    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-nxtrd\""
Jul 07 17:41:31.149294 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.149277    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 07 17:41:31.150063 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.150042    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 07 17:41:31.150217 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.150202    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 07 17:41:31.150301 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.150269    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 07 17:41:31.190112 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.190079    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-cabundle\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.190289 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.190160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-key\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.190289 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.190182    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snbcx\" (UniqueName: \"kubernetes.io/projected/c6e9adb1-6532-4730-8a3d-717d6205590d-kube-api-access-snbcx\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.204599 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.204566    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.294043 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.291237    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snbcx\" (UniqueName: \"kubernetes.io/projected/c6e9adb1-6532-4730-8a3d-717d6205590d-kube-api-access-snbcx\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.294043 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.291357    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-cabundle\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.294043 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.291514    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-key\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.294043 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.293553    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-cabundle\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.295595 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.295571    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/c6e9adb1-6532-4730-8a3d-717d6205590d-signing-key\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.302524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.302501    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snbcx\" (UniqueName: \"kubernetes.io/projected/c6e9adb1-6532-4730-8a3d-717d6205590d-kube-api-access-snbcx\") pod \"service-ca-758f599c5-tjpll\" (UID: \"c6e9adb1-6532-4730-8a3d-717d6205590d\") " pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.305850 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.305822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.455582 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.455542    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-tjpll"
Jul 07 17:41:31.494441 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.494408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:31.494567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.494454    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:31.494567 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:31.494538    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:31.494657 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:31.494574    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:31.494657 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:31.494623    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:33.494602795 +0000 UTC m=+47.688095749 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:31.494657 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:31.494637    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:33.494631134 +0000 UTC m=+47.688124087 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:31.624851 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.624820    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-tjpll"]
Jul 07 17:41:31.628403 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:31.628367    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6e9adb1_6532_4730_8a3d_717d6205590d.slice/crio-a526f86861c27dd715a781faa52f03ac67e304f6b821c0ba03cfa84c14b79acd WatchSource:0}: Error finding container a526f86861c27dd715a781faa52f03ac67e304f6b821c0ba03cfa84c14b79acd: Status 404 returned error can't find the container with id a526f86861c27dd715a781faa52f03ac67e304f6b821c0ba03cfa84c14b79acd
Jul 07 17:41:31.686403 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.686376    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tjpll" event={"ID":"c6e9adb1-6532-4730-8a3d-717d6205590d","Type":"ContainerStarted","Data":"a526f86861c27dd715a781faa52f03ac67e304f6b821c0ba03cfa84c14b79acd"}
Jul 07 17:41:31.989105 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:31.989079    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sg447_0a942f65-0608-4348-8c53-e24d8bdc5b35/dns-node-resolver/0.log"
Jul 07 17:41:32.132012 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:32.131982    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:32.590306 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:32.590277    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dztqc_cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56/node-ca/0.log"
Jul 07 17:41:32.690965 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:32.690929    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-tjpll" event={"ID":"c6e9adb1-6532-4730-8a3d-717d6205590d","Type":"ContainerStarted","Data":"2a04cebff370f9bd828253510078167db4fdd9a120984f71294fe16f1034f51b"}
Jul 07 17:41:32.708882 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:32.708839    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-tjpll" podStartSLOduration=1.7088229190000002 podStartE2EDuration="1.708822919s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:32.70838317 +0000 UTC m=+46.901876147" watchObservedRunningTime="2026-07-07 17:41:32.708822919 +0000 UTC m=+46.902315891"
Jul 07 17:41:32.805806 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:32.805744    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:32.805974 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:32.805901    2567 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 07 17:41:32.805974 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:32.805919    2567 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78fb494dd6-ksrq6: secret "image-registry-tls" not found
Jul 07 17:41:32.806050 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:32.805983    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls podName:06492315-6039-46b0-b25b-1f4df856078f nodeName:}" failed. No retries permitted until 2026-07-07 17:41:40.805966219 +0000 UTC m=+54.999459174 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls") pod "image-registry-78fb494dd6-ksrq6" (UID: "06492315-6039-46b0-b25b-1f4df856078f") : secret "image-registry-tls" not found
Jul 07 17:41:33.434927 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.434876    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.512443 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.512405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:33.512647 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.512452    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:33.512647 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:33.512537    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:33.512647 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:33.512621    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:37.512592569 +0000 UTC m=+51.706085528 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:33.512841 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:33.512654    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:33.512841 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:33.512707    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:37.512692156 +0000 UTC m=+51.706185115 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:33.562196 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.562151    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.589438 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.589403    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nwpp_3d927f87-d697-4ab2-97a0-5874af688f85/serve-healthcheck-canary/0.log"
Jul 07 17:41:33.669256 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.669219    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:33.767175 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:33.767085    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.330708 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:34.330671    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.955065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:34.955034    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.354078 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:35.354000    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.731106 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:35.731073    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.829445 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:35.829413    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:36.146984 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:36.146898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:36.363878 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:36.363846    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:36.726923 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:36.726888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.044913 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.044817    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:37.047250 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.047231    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d45c4ac-52f1-437e-ac8f-0ad7178ebdce-metrics-tls\") pod \"dns-default-w8v7h\" (UID: \"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce\") " pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:37.098836 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.098800    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:37.143486 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.143451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.257326 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.257293    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.264209 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.264181    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-w8v7h"]
Jul 07 17:41:37.267561 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:37.267537    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d45c4ac_52f1_437e_ac8f_0ad7178ebdce.slice/crio-1317beb6ab1ba3c0717b17999a77e695f2fd7bde055d6734707e9790e6a31484 WatchSource:0}: Error finding container 1317beb6ab1ba3c0717b17999a77e695f2fd7bde055d6734707e9790e6a31484: Status 404 returned error can't find the container with id 1317beb6ab1ba3c0717b17999a77e695f2fd7bde055d6734707e9790e6a31484
Jul 07 17:41:37.357210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.357118    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:37.549660 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.549622    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:37.549660 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.549661    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:37.549892 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:37.549754    2567 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:41:37.549892 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:37.549792    2567 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:37.549892 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:37.549846    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:45.549830257 +0000 UTC m=+59.743323210 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : configmap "kube-rbac-proxy" not found
Jul 07 17:41:37.549892 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:41:37.549863    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls podName:317afbee-08a6-4031-aaf6-10aa095ee97e nodeName:}" failed. No retries permitted until 2026-07-07 17:41:45.549856534 +0000 UTC m=+59.743349488 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sllsj" (UID: "317afbee-08a6-4031-aaf6-10aa095ee97e") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:41:37.704073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.704035    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8v7h" event={"ID":"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce","Type":"ContainerStarted","Data":"1317beb6ab1ba3c0717b17999a77e695f2fd7bde055d6734707e9790e6a31484"}
Jul 07 17:41:37.729831 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:37.729799    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:38.132435 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:38.132353    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:38.232995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:38.232957    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:38.528847 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:38.528812    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:38.927198 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:38.927135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:39.327165 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:39.327074    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:39.521383 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:39.521343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:39.729616 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:39.729588    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:39.829871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:39.829840    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:40.717641 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.717603    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8v7h" event={"ID":"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce","Type":"ContainerStarted","Data":"f249adc7c56743f31d98eeda33837c063c3bc8fb5b92d877f8e97963e23fe130"}
Jul 07 17:41:40.717863 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.717675    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-w8v7h" event={"ID":"8d45c4ac-52f1-437e-ac8f-0ad7178ebdce","Type":"ContainerStarted","Data":"35ab95467d36b7f1f4f3273e5be7e914a4b833c58d497987b649d8bd6ea5926e"}
Jul 07 17:41:40.717863 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.717791    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:40.736055 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.736012    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-w8v7h" podStartSLOduration=17.243248889 podStartE2EDuration="19.735998779s" totalImagesPullingTime="2.49274989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:40.734794782 +0000 UTC m=+54.928287757" watchObservedRunningTime="2026-07-07 17:41:40.735998779 +0000 UTC m=+54.929491755"
Jul 07 17:41:40.879090 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.879057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:40.881723 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.881694    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"image-registry-78fb494dd6-ksrq6\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") " pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:40.900840 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.900805    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:40.921641 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:40.921614    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.055511 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.055479    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:41:41.058628 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:41.058595    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06492315_6039_46b0_b25b_1f4df856078f.slice/crio-d2774f4d01ebf396ced6f4ffec943703937ef1a53d30bee7ac28a91b1cb66fbd WatchSource:0}: Error finding container d2774f4d01ebf396ced6f4ffec943703937ef1a53d30bee7ac28a91b1cb66fbd: Status 404 returned error can't find the container with id d2774f4d01ebf396ced6f4ffec943703937ef1a53d30bee7ac28a91b1cb66fbd
Jul 07 17:41:41.122900 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.122844    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.324320 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.324202    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.521470 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.521434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.722348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.722297    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" event={"ID":"06492315-6039-46b0-b25b-1f4df856078f","Type":"ContainerStarted","Data":"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"}
Jul 07 17:41:41.722348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.722356    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" event={"ID":"06492315-6039-46b0-b25b-1f4df856078f","Type":"ContainerStarted","Data":"d2774f4d01ebf396ced6f4ffec943703937ef1a53d30bee7ac28a91b1cb66fbd"}
Jul 07 17:41:41.743220 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.743189    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.747739 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:41.747693    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" podStartSLOduration=17.747676944 podStartE2EDuration="17.747676944s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:41.746337676 +0000 UTC m=+55.939830651" watchObservedRunningTime="2026-07-07 17:41:41.747676944 +0000 UTC m=+55.941169919"
Jul 07 17:41:42.223970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:42.223941    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:42.721023 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:42.720991    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:42.725123 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:42.725102    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:41:43.120826 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.120745    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.328635 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.328600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.461973 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.461939    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.558963 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.558929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.680857 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.680808    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.923744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:43.923710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:44.126369 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:44.126335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:44.186524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:44.186451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:44.524983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:44.524900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:45.619981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.619943    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:45.619981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.619989    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:45.620508 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.620470    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/317afbee-08a6-4031-aaf6-10aa095ee97e-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:45.622459 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.622437    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/317afbee-08a6-4031-aaf6-10aa095ee97e-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sllsj\" (UID: \"317afbee-08a6-4031-aaf6-10aa095ee97e\") " pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:45.741133 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.741104    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sllsj"
Jul 07 17:41:45.869496 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:45.869463    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sllsj"]
Jul 07 17:41:45.872648 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:45.872619    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod317afbee_08a6_4031_aaf6_10aa095ee97e.slice/crio-7da3ec9265b2f15b91208939ba476edf9b4e753e94b9ca4a4585db515147f827 WatchSource:0}: Error finding container 7da3ec9265b2f15b91208939ba476edf9b4e753e94b9ca4a4585db515147f827: Status 404 returned error can't find the container with id 7da3ec9265b2f15b91208939ba476edf9b4e753e94b9ca4a4585db515147f827
Jul 07 17:41:46.140246 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:46.140119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:46.193703 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:46.193656    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:46.739744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:46.739699    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sllsj" event={"ID":"317afbee-08a6-4031-aaf6-10aa095ee97e","Type":"ContainerStarted","Data":"7da3ec9265b2f15b91208939ba476edf9b4e753e94b9ca4a4585db515147f827"}
Jul 07 17:41:47.647894 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:47.647866    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pb6hm"
Jul 07 17:41:49.753459 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:49.753423    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sllsj" event={"ID":"317afbee-08a6-4031-aaf6-10aa095ee97e","Type":"ContainerStarted","Data":"395a065c58be1cc7097b8c4bfb29ee01781f8f5f2b4808ab731bcba56eb30528"}
Jul 07 17:41:50.507211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.507117    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"]
Jul 07 17:41:50.509002 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.508984    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"]
Jul 07 17:41:50.509132 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.509113    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.511292 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.511272    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.511541 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.511520    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-z6v92\""
Jul 07 17:41:50.511655 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.511583    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 07 17:41:50.512524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.512510    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 07 17:41:50.513645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.513628    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 07 17:41:50.513926 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.513911    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 17:41:50.514226 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.514209    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 17:41:50.514827 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.514810    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 17:41:50.521083 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.521062    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"]
Jul 07 17:41:50.522304 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.522282    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"]
Jul 07 17:41:50.533578 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.533556    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:41:50.541824 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.541710    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"]
Jul 07 17:41:50.544521 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.544497    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:50.547794 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.547717    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-wfp75\""
Jul 07 17:41:50.549791 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.548365    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 07 17:41:50.558649 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.558624    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"]
Jul 07 17:41:50.579543 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.579507    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8cff7fdd8-wdnqb"]
Jul 07 17:41:50.581932 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.581907    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.597520 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.597490    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cff7fdd8-wdnqb"]
Jul 07 17:41:50.632743 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.632712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:50.665004 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.664961    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71c211e6-f242-46d2-88f5-82693174a708-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.665177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665018    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-image-registry-private-configuration\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665052    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-certificates\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665082    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49517b2-fa19-431a-a851-7f9978e3508b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.665177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665118    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49517b2-fa19-431a-a851-7f9978e3508b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.665177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665146    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-tls\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665203    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-bound-sa-token\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665227    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71c211e6-f242-46d2-88f5-82693174a708-tmp\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665250    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsf89\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-kube-api-access-tsf89\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665287    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-trusted-ca\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665320    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rznnl\" (UniqueName: \"kubernetes.io/projected/71c211e6-f242-46d2-88f5-82693174a708-kube-api-access-rznnl\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665362    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-installation-pull-secrets\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.665393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665386    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/557a6aac-ce7a-4771-b941-dd0386394a9c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qdrft\" (UID: \"557a6aac-ce7a-4771-b941-dd0386394a9c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:50.665641 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.665457    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2f2773e-208c-4eef-905f-18ca9e6d3745-ca-trust-extracted\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.725478 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.725445    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-w8v7h"
Jul 07 17:41:50.734989 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.734960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:50.758884 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.758809    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sllsj" event={"ID":"317afbee-08a6-4031-aaf6-10aa095ee97e","Type":"ContainerStarted","Data":"ef370eab61633cda8ae66afac9f047c20ad2d9c19c0db8b76be33cc5e9074b9b"}
Jul 07 17:41:50.766054 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766021    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-trusted-ca\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766067    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rznnl\" (UniqueName: \"kubernetes.io/projected/71c211e6-f242-46d2-88f5-82693174a708-kube-api-access-rznnl\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.766200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766107    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-installation-pull-secrets\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766124    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/557a6aac-ce7a-4771-b941-dd0386394a9c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qdrft\" (UID: \"557a6aac-ce7a-4771-b941-dd0386394a9c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:50.766200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2f2773e-208c-4eef-905f-18ca9e6d3745-ca-trust-extracted\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766177    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71c211e6-f242-46d2-88f5-82693174a708-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766208    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-image-registry-private-configuration\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766235    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-certificates\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766257    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49517b2-fa19-431a-a851-7f9978e3508b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766288    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49517b2-fa19-431a-a851-7f9978e3508b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766316    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-tls\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766368    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-bound-sa-token\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766392    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71c211e6-f242-46d2-88f5-82693174a708-tmp\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.766432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.766417    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsf89\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-kube-api-access-tsf89\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.767172 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.767148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-certificates\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.767270 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.767147    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/71c211e6-f242-46d2-88f5-82693174a708-tmp\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.767326 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.767256    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c2f2773e-208c-4eef-905f-18ca9e6d3745-trusted-ca\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.767381 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.767340    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c2f2773e-208c-4eef-905f-18ca9e6d3745-ca-trust-extracted\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.768368 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.768215    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/f49517b2-fa19-431a-a851-7f9978e3508b-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.769373 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.769329    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-installation-pull-secrets\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.769978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.769945    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-registry-tls\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.770260 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.770229    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/71c211e6-f242-46d2-88f5-82693174a708-klusterlet-config\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.770395 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.770294    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/557a6aac-ce7a-4771-b941-dd0386394a9c-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-qdrft\" (UID: \"557a6aac-ce7a-4771-b941-dd0386394a9c\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:50.770395 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.770370    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c2f2773e-208c-4eef-905f-18ca9e6d3745-image-registry-private-configuration\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.770800 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.770752    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f49517b2-fa19-431a-a851-7f9978e3508b-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-5mwk2\" (UID: \"f49517b2-fa19-431a-a851-7f9978e3508b\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.776343 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.776314    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsf89\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-kube-api-access-tsf89\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.776748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.776729    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rznnl\" (UniqueName: \"kubernetes.io/projected/71c211e6-f242-46d2-88f5-82693174a708-kube-api-access-rznnl\") pod \"klusterlet-addon-workmgr-75c887d6cf-5d26r\" (UID: \"71c211e6-f242-46d2-88f5-82693174a708\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.776840 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.776755    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c2f2773e-208c-4eef-905f-18ca9e6d3745-bound-sa-token\") pod \"image-registry-8cff7fdd8-wdnqb\" (UID: \"c2f2773e-208c-4eef-905f-18ca9e6d3745\") " pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.819522 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.819483    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"
Jul 07 17:41:50.825851 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.825809    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:41:50.837221 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.837189    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:50.856752 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.856641    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:50.894527 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.894025    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:50.998576 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:50.998546    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2"]
Jul 07 17:41:51.004905 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:51.004872    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf49517b2_fa19_431a_a851_7f9978e3508b.slice/crio-3ce1c7e51f21079cd1ad39f1a446a14087a905b852ad15857094a7405e38ffcc WatchSource:0}: Error finding container 3ce1c7e51f21079cd1ad39f1a446a14087a905b852ad15857094a7405e38ffcc: Status 404 returned error can't find the container with id 3ce1c7e51f21079cd1ad39f1a446a14087a905b852ad15857094a7405e38ffcc
Jul 07 17:41:51.019670 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.019639    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"]
Jul 07 17:41:51.021782 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:51.021681    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71c211e6_f242_46d2_88f5_82693174a708.slice/crio-89afa898b1112886791029320fcb4682d5fd110889b9f87bc8b25a30883681ac WatchSource:0}: Error finding container 89afa898b1112886791029320fcb4682d5fd110889b9f87bc8b25a30883681ac: Status 404 returned error can't find the container with id 89afa898b1112886791029320fcb4682d5fd110889b9f87bc8b25a30883681ac
Jul 07 17:41:51.058187 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.058156    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"]
Jul 07 17:41:51.061234 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:51.061200    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod557a6aac_ce7a_4771_b941_dd0386394a9c.slice/crio-af15e7697c8ca6857e67aa586a7b48472b1b30fe80448c8aa9cb506af55a4457 WatchSource:0}: Error finding container af15e7697c8ca6857e67aa586a7b48472b1b30fe80448c8aa9cb506af55a4457: Status 404 returned error can't find the container with id af15e7697c8ca6857e67aa586a7b48472b1b30fe80448c8aa9cb506af55a4457
Jul 07 17:41:51.070956 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.070928    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.084494 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.084467    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8cff7fdd8-wdnqb"]
Jul 07 17:41:51.088284 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:51.088252    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2f2773e_208c_4eef_905f_18ca9e6d3745.slice/crio-7bd0815d2c585332e043791d571aa0eff939c1cc2ddd07fbbd798c4ee5c3a7b5 WatchSource:0}: Error finding container 7bd0815d2c585332e043791d571aa0eff939c1cc2ddd07fbbd798c4ee5c3a7b5: Status 404 returned error can't find the container with id 7bd0815d2c585332e043791d571aa0eff939c1cc2ddd07fbbd798c4ee5c3a7b5
Jul 07 17:41:51.227706 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.227663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.348093 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.348001    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.544237 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.544198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.716394 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.716354    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.765524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.765484    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2" event={"ID":"f49517b2-fa19-431a-a851-7f9978e3508b","Type":"ContainerStarted","Data":"3ce1c7e51f21079cd1ad39f1a446a14087a905b852ad15857094a7405e38ffcc"}
Jul 07 17:41:51.767133 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.767099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r" event={"ID":"71c211e6-f242-46d2-88f5-82693174a708","Type":"ContainerStarted","Data":"89afa898b1112886791029320fcb4682d5fd110889b9f87bc8b25a30883681ac"}
Jul 07 17:41:51.769680 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.769194    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb" event={"ID":"c2f2773e-208c-4eef-905f-18ca9e6d3745","Type":"ContainerStarted","Data":"06682cf6ee54c9b336abb510311c7f276492d07378d4df5e2aed48a58250c3ab"}
Jul 07 17:41:51.769680 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.769245    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb" event={"ID":"c2f2773e-208c-4eef-905f-18ca9e6d3745","Type":"ContainerStarted","Data":"7bd0815d2c585332e043791d571aa0eff939c1cc2ddd07fbbd798c4ee5c3a7b5"}
Jul 07 17:41:51.769680 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.769313    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:41:51.771664 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.771645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft" event={"ID":"557a6aac-ce7a-4771-b941-dd0386394a9c","Type":"ContainerStarted","Data":"af15e7697c8ca6857e67aa586a7b48472b1b30fe80448c8aa9cb506af55a4457"}
Jul 07 17:41:51.779575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.779543    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:51.790889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.790839    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb" podStartSLOduration=1.790822106 podStartE2EDuration="1.790822106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:51.790301289 +0000 UTC m=+65.983794265" watchObservedRunningTime="2026-07-07 17:41:51.790822106 +0000 UTC m=+65.984315093"
Jul 07 17:41:51.948459 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:51.948428    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:52.014272 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.014194    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:52.079425 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.079394    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:52.081824 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.081799    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:41:52.092675 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.092649    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/24ce3c0a-c64f-4817-8d12-9b0e500226a2-metrics-certs\") pod \"network-metrics-daemon-zzw4b\" (UID: \"24ce3c0a-c64f-4817-8d12-9b0e500226a2\") " pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:52.180205 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.180168    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:52.182701 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.182678    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:41:52.193381 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.193353    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f-original-pull-secret\") pod \"global-pull-secret-syncer-bgktw\" (UID: \"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f\") " pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:52.280820 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.280737    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:52.283219 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.283189    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:41:52.293666 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.293640    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:41:52.293829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.293727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-92crh\""
Jul 07 17:41:52.298876 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.298853    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bgktw"
Jul 07 17:41:52.302092 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.302063    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-zzw4b"
Jul 07 17:41:52.304800 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.304751    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dvsb\" (UniqueName: \"kubernetes.io/projected/a5c6e776-171d-4291-822d-bf8cbee652df-kube-api-access-9dvsb\") pod \"network-check-target-lwptt\" (UID: \"a5c6e776-171d-4291-822d-bf8cbee652df\") " pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:52.607047 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.606965    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-njwcl\""
Jul 07 17:41:52.614826 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.614794    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:41:52.950097 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:52.950018    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:53.059375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.059287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:53.164210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.164164    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:53.604955 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.604929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:53.709936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.708402    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:53.773520 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.773397    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-zzw4b"]
Jul 07 17:41:53.778036 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:53.778002    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24ce3c0a_c64f_4817_8d12_9b0e500226a2.slice/crio-6184b2a09ca8daeb7c0c23960b328863daff7d0c5e74441e0f2e44471ee6ae2d WatchSource:0}: Error finding container 6184b2a09ca8daeb7c0c23960b328863daff7d0c5e74441e0f2e44471ee6ae2d: Status 404 returned error can't find the container with id 6184b2a09ca8daeb7c0c23960b328863daff7d0c5e74441e0f2e44471ee6ae2d
Jul 07 17:41:53.782614 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.782551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sllsj" event={"ID":"317afbee-08a6-4031-aaf6-10aa095ee97e","Type":"ContainerStarted","Data":"d7bec58beeaa9db04dd420a6daf4c4c5e20a913f0ffebc5e9da1c4c167bf51e7"}
Jul 07 17:41:53.785978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.785948    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2" event={"ID":"f49517b2-fa19-431a-a851-7f9978e3508b","Type":"ContainerStarted","Data":"780e133084af17d1aefdb3dcb29605e7c3170d7c5fc433b885dc1fbca97de2f3"}
Jul 07 17:41:53.787807 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.787784    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft" event={"ID":"557a6aac-ce7a-4771-b941-dd0386394a9c","Type":"ContainerStarted","Data":"24c6967afd4c95665c0348c8fb821a5050bbee60541877d0537cdbacc4508194"}
Jul 07 17:41:53.788000 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.787983    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:53.794431 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.794406    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft"
Jul 07 17:41:53.801410 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.801378    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-lwptt"]
Jul 07 17:41:53.804870 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:53.804835    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda5c6e776_171d_4291_822d_bf8cbee652df.slice/crio-fcf2cce01944bb9f145517fe839d177c1c8b4bc7a606ca3b3f09a2e9ac3f0318 WatchSource:0}: Error finding container fcf2cce01944bb9f145517fe839d177c1c8b4bc7a606ca3b3f09a2e9ac3f0318: Status 404 returned error can't find the container with id fcf2cce01944bb9f145517fe839d177c1c8b4bc7a606ca3b3f09a2e9ac3f0318
Jul 07 17:41:53.812712 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.811485    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sllsj" podStartSLOduration=17.219341183 podStartE2EDuration="24.81146705s" totalImagesPullingTime="7.592125867s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:41:29 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:53.811018513 +0000 UTC m=+68.004511491" watchObservedRunningTime="2026-07-07 17:41:53.81146705 +0000 UTC m=+68.004960028"
Jul 07 17:41:53.844990 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.844856    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-5mwk2" podStartSLOduration=1.261936944 podStartE2EDuration="3.844834426s" totalImagesPullingTime="2.582897482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:53.843906832 +0000 UTC m=+68.037399811" watchObservedRunningTime="2026-07-07 17:41:53.844834426 +0000 UTC m=+68.038327403"
Jul 07 17:41:53.984199 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.984166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.000076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:53.999994    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-qdrft" podStartSLOduration=1.476434709 podStartE2EDuration="3.99997299s" totalImagesPullingTime="2.523538281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:53.865911229 +0000 UTC m=+68.059404207" watchObservedRunningTime="2026-07-07 17:41:53.99997299 +0000 UTC m=+68.193466156"
Jul 07 17:41:54.000455 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.000435    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bgktw"]
Jul 07 17:41:54.004381 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:41:54.004349    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2c6dc91_27a0_4b0e_af69_067ab3e0ff7f.slice/crio-0ab613357d68bd6daeb3513547bd163afc05d4f037ada30cc4359cf071242d37 WatchSource:0}: Error finding container 0ab613357d68bd6daeb3513547bd163afc05d4f037ada30cc4359cf071242d37: Status 404 returned error can't find the container with id 0ab613357d68bd6daeb3513547bd163afc05d4f037ada30cc4359cf071242d37
Jul 07 17:41:54.080341 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.080295    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.181281 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.181180    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.280980 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.280940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.671138 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.671100    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.739488 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.739449    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:54.794689 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.794651    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgktw" event={"ID":"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f","Type":"ContainerStarted","Data":"0ab613357d68bd6daeb3513547bd163afc05d4f037ada30cc4359cf071242d37"}
Jul 07 17:41:54.796415 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.796385    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzw4b" event={"ID":"24ce3c0a-c64f-4817-8d12-9b0e500226a2","Type":"ContainerStarted","Data":"6184b2a09ca8daeb7c0c23960b328863daff7d0c5e74441e0f2e44471ee6ae2d"}
Jul 07 17:41:54.798550 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:54.798520    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lwptt" event={"ID":"a5c6e776-171d-4291-822d-bf8cbee652df","Type":"ContainerStarted","Data":"fcf2cce01944bb9f145517fe839d177c1c8b4bc7a606ca3b3f09a2e9ac3f0318"}
Jul 07 17:41:55.091894 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:55.091729    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:57.199742 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:57.199699    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:59.836968 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:59.836931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:59.939061 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:41:59.939022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.057124 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.057063    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.110700 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.110625    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"]
Jul 07 17:42:00.113849 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.113827    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.123788 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.123465    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 07 17:42:00.124253 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.124233    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 07 17:42:00.125302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.125279    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x9rwx\""
Jul 07 17:42:00.125843 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.125648    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:42:00.125843 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.125661    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:42:00.128673 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.127632    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:42:00.131420 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.131386    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"]
Jul 07 17:42:00.146656 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.146622    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-4dsdd"]
Jul 07 17:42:00.163210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.163181    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.168257 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.168210    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-fcg8q\""
Jul 07 17:42:00.168486 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.168469    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:42:00.168779 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.168751    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:42:00.174758 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.173290    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.180870 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.176345    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:42:00.243463 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.243286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-metrics-client-ca\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260277    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-wtmp\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260347    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260518    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-sys\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-accelerators-collector-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.260838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xfthx\" (UniqueName: \"kubernetes.io/projected/ba55a659-61d3-418a-9ac2-f302c1d42c93-kube-api-access-xfthx\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.261235    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-root\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.261738    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.261862    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89vcr\" (UniqueName: \"kubernetes.io/projected/f1957152-74a3-41b9-9ea1-fc33ec8d481d-kube-api-access-89vcr\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.261966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1957152-74a3-41b9-9ea1-fc33ec8d481d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.263811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.262093    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-textfile\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.351333 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.351245    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.359393 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.359350    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:00.362695 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.362619    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.362906 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.362882    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.362996 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.362931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.363376 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:00.363354    2567 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 07 17:42:00.363563 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:00.363551    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls podName:ba55a659-61d3-418a-9ac2-f302c1d42c93 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:00.863528773 +0000 UTC m=+75.057021732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls") pod "node-exporter-4dsdd" (UID: "ba55a659-61d3-418a-9ac2-f302c1d42c93") : secret "node-exporter-tls" not found
Jul 07 17:42:00.363656 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363449    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-sys\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363734 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-sys\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363868 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363843    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-accelerators-collector-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363979 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363886    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xfthx\" (UniqueName: \"kubernetes.io/projected/ba55a659-61d3-418a-9ac2-f302c1d42c93-kube-api-access-xfthx\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363979 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363913    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-root\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363979 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.363979 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.363976    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89vcr\" (UniqueName: \"kubernetes.io/projected/f1957152-74a3-41b9-9ea1-fc33ec8d481d-kube-api-access-89vcr\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.364190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364005    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1957152-74a3-41b9-9ea1-fc33ec8d481d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.364190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364047    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-textfile\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.364190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364080    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-metrics-client-ca\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.364190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-wtmp\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.364190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.364472 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:00.364254    2567 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 07 17:42:00.364472 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:00.364296    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls podName:f1957152-74a3-41b9-9ea1-fc33ec8d481d nodeName:}" failed. No retries permitted until 2026-07-07 17:42:00.864281305 +0000 UTC m=+75.057774265 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls") pod "openshift-state-metrics-54cf96dfcf-clr72" (UID: "f1957152-74a3-41b9-9ea1-fc33ec8d481d") : secret "openshift-state-metrics-tls" not found
Jul 07 17:42:00.364958 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.364935    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-accelerators-collector-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.365020 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.365004    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f1957152-74a3-41b9-9ea1-fc33ec8d481d-metrics-client-ca\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.365557 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.365202    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-root\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.365557 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.365228    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-textfile\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.365717 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.365659    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ba55a659-61d3-418a-9ac2-f302c1d42c93-metrics-client-ca\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.365829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.365809    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-wtmp\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.366254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366233    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:42:00.366353 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366271    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l6245\""
Jul 07 17:42:00.366498 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366472    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:42:00.366587 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366568    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:42:00.366666 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366473    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:42:00.366757 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366742    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:42:00.366941 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366921    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:42:00.367025 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.366960    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:42:00.369091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.369021    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.379490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.377677    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:00.384159 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.384102    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.395219 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.395162    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-89vcr\" (UniqueName: \"kubernetes.io/projected/f1957152-74a3-41b9-9ea1-fc33ec8d481d-kube-api-access-89vcr\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.399947 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.399920    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xfthx\" (UniqueName: \"kubernetes.io/projected/ba55a659-61d3-418a-9ac2-f302c1d42c93-kube-api-access-xfthx\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.464944 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.464902    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.465099 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.464954    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.465099 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.464977    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.465271 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.465004    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jtpd\" (UniqueName: \"kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.465322 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.465295    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.465361 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.465335    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.472939 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.472897    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.546179 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.546149    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566126    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566188    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566212    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jtpd\" (UniqueName: \"kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566271    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.566310    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.567092    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.567981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.567620    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.570160 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.569109    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.578965 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.578837    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.582914 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.582859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jtpd\" (UniqueName: \"kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.587181 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.587124    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.590295 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.590266    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config\") pod \"console-5645496db4-rl9hc\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") " pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.658212 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.658077    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.700577 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.700532    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:00.774997 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.774964    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.829899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.827499    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r" event={"ID":"71c211e6-f242-46d2-88f5-82693174a708","Type":"ContainerStarted","Data":"cb44b483b08148878532081d1a7591917e47a9e8b61c44d4b5f32573a69dc23e"}
Jul 07 17:42:00.829899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.829677    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:42:00.830565 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.830490    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r"
Jul 07 17:42:00.832508 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.832476    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-lwptt" event={"ID":"a5c6e776-171d-4291-822d-bf8cbee652df","Type":"ContainerStarted","Data":"c67eda461a8cd471ec69cd53d94b0193b7377ddec7043a090af676bdb74d2844"}
Jul 07 17:42:00.833146 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.833100    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:42:00.835022 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.834560    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bgktw" event={"ID":"f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f","Type":"ContainerStarted","Data":"0ba9d5d25544290caf1834004eeacd56269024f6a2700d24907789c57162d285"}
Jul 07 17:42:00.838549 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.838191    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzw4b" event={"ID":"24ce3c0a-c64f-4817-8d12-9b0e500226a2","Type":"ContainerStarted","Data":"3035aac96a6d0dc12bc3e931fd39cf09f6319d5b3e92a5a820f1c0814bd46c3f"}
Jul 07 17:42:00.838549 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.838243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-zzw4b" event={"ID":"24ce3c0a-c64f-4817-8d12-9b0e500226a2","Type":"ContainerStarted","Data":"146d70582b7e5c66e1cc35dbcc88972cecae1b335340daf02fdb82140cbb8f6c"}
Jul 07 17:42:00.847914 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.847520    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-75c887d6cf-5d26r" podStartSLOduration=1.35170279 podStartE2EDuration="10.847499081s" totalImagesPullingTime="9.495796291s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:00.846471209 +0000 UTC m=+75.039964186" watchObservedRunningTime="2026-07-07 17:42:00.847499081 +0000 UTC m=+75.040992063"
Jul 07 17:42:00.853486 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.853451    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:00.869365 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.869250    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-lwptt" podStartSLOduration=68.160885155 podStartE2EDuration="1m14.869228056s" totalImagesPullingTime="6.708342901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:00.867660677 +0000 UTC m=+75.061153644" watchObservedRunningTime="2026-07-07 17:42:00.869228056 +0000 UTC m=+75.062721032"
Jul 07 17:42:00.870065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.870041    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.870166 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.870108    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.872896 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.872842    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ba55a659-61d3-418a-9ac2-f302c1d42c93-node-exporter-tls\") pod \"node-exporter-4dsdd\" (UID: \"ba55a659-61d3-418a-9ac2-f302c1d42c93\") " pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:00.873025 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.873007    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f1957152-74a3-41b9-9ea1-fc33ec8d481d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-54cf96dfcf-clr72\" (UID: \"f1957152-74a3-41b9-9ea1-fc33ec8d481d\") " pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:00.896028 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.895973    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bgktw" podStartSLOduration=68.381654259 podStartE2EDuration="1m14.895955775s" totalImagesPullingTime="6.514301516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:00.894918423 +0000 UTC m=+75.088411400" watchObservedRunningTime="2026-07-07 17:42:00.895955775 +0000 UTC m=+75.089448750"
Jul 07 17:42:00.905738 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:00.905701    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e1385a2_b923_4a04_baf6_97abaa58e07c.slice/crio-702fc949c6f6b3f9fba4d4396179e509d1fd1a66148a97526cc10da99d18dfd2 WatchSource:0}: Error finding container 702fc949c6f6b3f9fba4d4396179e509d1fd1a66148a97526cc10da99d18dfd2: Status 404 returned error can't find the container with id 702fc949c6f6b3f9fba4d4396179e509d1fd1a66148a97526cc10da99d18dfd2
Jul 07 17:42:00.905918 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.905793    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:00.918866 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.918759    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-zzw4b" podStartSLOduration=68.199218618 podStartE2EDuration="1m14.918744047s" totalImagesPullingTime="6.719525429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:40:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:00.917832393 +0000 UTC m=+75.111325367" watchObservedRunningTime="2026-07-07 17:42:00.918744047 +0000 UTC m=+75.112237019"
Jul 07 17:42:00.946191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:00.946146    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.029984 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.029946    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"
Jul 07 17:42:01.061961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.061916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.093964 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.093931    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-4dsdd"
Jul 07 17:42:01.109502 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:01.109465    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba55a659_61d3_418a_9ac2_f302c1d42c93.slice/crio-af56412e96abfe55d973998ead600f1974609fb147674c3be61b322fa40c0324 WatchSource:0}: Error finding container af56412e96abfe55d973998ead600f1974609fb147674c3be61b322fa40c0324: Status 404 returned error can't find the container with id af56412e96abfe55d973998ead600f1974609fb147674c3be61b322fa40c0324
Jul 07 17:42:01.157946 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.157917    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.183115 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.183093    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72"]
Jul 07 17:42:01.186194 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:01.186165    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1957152_74a3_41b9_9ea1_fc33ec8d481d.slice/crio-09c9c6cd86a927f7e4b0fc1490a55522ea69e3392272a82999ef1f07c061d3d7 WatchSource:0}: Error finding container 09c9c6cd86a927f7e4b0fc1490a55522ea69e3392272a82999ef1f07c061d3d7: Status 404 returned error can't find the container with id 09c9c6cd86a927f7e4b0fc1490a55522ea69e3392272a82999ef1f07c061d3d7
Jul 07 17:42:01.194845 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.194819    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:42:01.203331 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.203308    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.209538 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.209513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 17:42:01.209629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.209513    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 17:42:01.209703 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.209513    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 17:42:01.209927 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.209914    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 17:42:01.210236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.210222    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 17:42:01.210603 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.210590    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 17:42:01.210669 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.210656    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 17:42:01.211454 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.211429    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 17:42:01.211454 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.211446    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 17:42:01.211866 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.211853    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wxtw5\""
Jul 07 17:42:01.221607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.221587    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:42:01.255042 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.254998    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.374689 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374597    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374689 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374648    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374689 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374684    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374744    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374797    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374815    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhwrs\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374846    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374890    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.374930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374921    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.375152 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374938    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.375152 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374956    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.375152 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.374980    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.379370 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.379346    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:01.476155 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476119    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476155 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476156    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476396 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476179    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476396 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476199    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476396 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476220    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476396 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476350    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhwrs\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476405    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476505    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476534    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476563    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476608 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.476608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.476969 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:01.476848    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle podName:7311e5b3-c1b0-4457-a273-aeeefd603351 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:01.976827214 +0000 UTC m=+76.170320168 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351") : configmap references non-existent config key: ca-bundle.crt
Jul 07 17:42:01.477077 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.477056    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.477261 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.477234    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.479673 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.479647    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.479805 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.479654    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.479896 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.479872    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.480134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.479810    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.480134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.480035    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.480381 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.480362    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.480470 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.480448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.481378 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.481357    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.482015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.481996    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.485712 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.485690    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhwrs\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.848613 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.848566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72" event={"ID":"f1957152-74a3-41b9-9ea1-fc33ec8d481d","Type":"ContainerStarted","Data":"914ef35c3f98e19c03f227124192a76415633148ed4baeba839b8a02be2295ce"}
Jul 07 17:42:01.849104 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.848654    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72" event={"ID":"f1957152-74a3-41b9-9ea1-fc33ec8d481d","Type":"ContainerStarted","Data":"f6bee46a11967478300b180372b440d4cc1396ad1464aa86420bd08f67de8bc6"}
Jul 07 17:42:01.849104 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.848689    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72" event={"ID":"f1957152-74a3-41b9-9ea1-fc33ec8d481d","Type":"ContainerStarted","Data":"09c9c6cd86a927f7e4b0fc1490a55522ea69e3392272a82999ef1f07c061d3d7"}
Jul 07 17:42:01.850619 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.850586    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645496db4-rl9hc" event={"ID":"2e1385a2-b923-4a04-baf6-97abaa58e07c","Type":"ContainerStarted","Data":"702fc949c6f6b3f9fba4d4396179e509d1fd1a66148a97526cc10da99d18dfd2"}
Jul 07 17:42:01.854151 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.852898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4dsdd" event={"ID":"ba55a659-61d3-418a-9ac2-f302c1d42c93","Type":"ContainerStarted","Data":"af56412e96abfe55d973998ead600f1974609fb147674c3be61b322fa40c0324"}
Jul 07 17:42:01.981380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.981333    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:01.983604 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:01.983389    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:02.127302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.127229    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:42:02.560859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.560831    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:42:02.563403 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:02.563364    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7311e5b3_c1b0_4457_a273_aeeefd603351.slice/crio-177040e814af66d028efcf17cc0199b73e4b760ee414c9732ad130b1db6c2e4d WatchSource:0}: Error finding container 177040e814af66d028efcf17cc0199b73e4b760ee414c9732ad130b1db6c2e4d: Status 404 returned error can't find the container with id 177040e814af66d028efcf17cc0199b73e4b760ee414c9732ad130b1db6c2e4d
Jul 07 17:42:02.858186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.858146    2567 generic.go:356] "Generic (PLEG): container finished" podID="ba55a659-61d3-418a-9ac2-f302c1d42c93" containerID="77b737520fafd505ad0a668a1e11d2de4e168814ddc3d984c30417e0e53496ec" exitCode=0
Jul 07 17:42:02.858584 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.858263    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4dsdd" event={"ID":"ba55a659-61d3-418a-9ac2-f302c1d42c93","Type":"ContainerDied","Data":"77b737520fafd505ad0a668a1e11d2de4e168814ddc3d984c30417e0e53496ec"}
Jul 07 17:42:02.861909 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.861871    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72" event={"ID":"f1957152-74a3-41b9-9ea1-fc33ec8d481d","Type":"ContainerStarted","Data":"d952d120d77671871a7bd14b649126b884717208ead5eb2404969f2692214fed"}
Jul 07 17:42:02.867997 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.867967    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"177040e814af66d028efcf17cc0199b73e4b760ee414c9732ad130b1db6c2e4d"}
Jul 07 17:42:02.909086 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:02.909035    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-54cf96dfcf-clr72" podStartSLOduration=1.842182206 podStartE2EDuration="2.909014249s" totalImagesPullingTime="1.066832043s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:02.908157415 +0000 UTC m=+77.101650426" watchObservedRunningTime="2026-07-07 17:42:02.909014249 +0000 UTC m=+77.102507246"
Jul 07 17:42:03.100432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.100358    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.164567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.164453    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.428308 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.428154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.686038 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.685953    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.764744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.764707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.861167 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.861119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.875447 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.875399    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4dsdd" event={"ID":"ba55a659-61d3-418a-9ac2-f302c1d42c93","Type":"ContainerStarted","Data":"b321f0c122a22b9cf29fd1d2e8ed7edbc6bb8df3b5b3dc20c3f29508fca4115b"}
Jul 07 17:42:03.875633 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:03.875511    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-4dsdd" event={"ID":"ba55a659-61d3-418a-9ac2-f302c1d42c93","Type":"ContainerStarted","Data":"823b9a9404cca8d865bbc69f560721bdefa11ff52d7414224c4cc514a314b179"}
Jul 07 17:42:04.753368 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.753278    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:04.855009 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.854972    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:04.880817 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.880786    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd" exitCode=0
Jul 07 17:42:04.881239 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.880869    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"}
Jul 07 17:42:04.882858 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.882719    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645496db4-rl9hc" event={"ID":"2e1385a2-b923-4a04-baf6-97abaa58e07c","Type":"ContainerStarted","Data":"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"}
Jul 07 17:42:04.915296 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.915239    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-4dsdd" podStartSLOduration=3.553598151 podStartE2EDuration="4.915218877s" totalImagesPullingTime="1.277137986s" totalInitContainerRuntime="84.48274ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:03.900425805 +0000 UTC m=+78.093918781" watchObservedRunningTime="2026-07-07 17:42:04.915218877 +0000 UTC m=+79.108711854"
Jul 07 17:42:04.919578 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.919552    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:04.931813 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:04.931751    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5645496db4-rl9hc" podStartSLOduration=1.335210279 podStartE2EDuration="4.931738358s" totalImagesPullingTime="3.596528079s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:04.930911178 +0000 UTC m=+79.124404155" watchObservedRunningTime="2026-07-07 17:42:04.931738358 +0000 UTC m=+79.125231333"
Jul 07 17:42:05.413230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.413194    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-869cd988bd-fg2pf"]
Jul 07 17:42:05.416201 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.416180    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.421725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.421683    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 07 17:42:05.421725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.421685    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 07 17:42:05.422034 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.421686    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 07 17:42:05.422188 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.422046    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-zccbb\""
Jul 07 17:42:05.422632 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.422305    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 07 17:42:05.423021 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.422997    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 07 17:42:05.430263 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.430240    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 07 17:42:05.437207 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.437182    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-869cd988bd-fg2pf"]
Jul 07 17:42:05.518713 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518677    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.518943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518790    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-serving-certs-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.518943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518820    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.518943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518845    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.518943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518900    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-metrics-client-ca\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.518943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518941    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-federate-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.519162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.518988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.519162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.519066    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8qz\" (UniqueName: \"kubernetes.io/projected/612dea83-31d4-432e-a044-f1e13a3b3bd6-kube-api-access-hn8qz\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620007 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.619968    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-serving-certs-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620016    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620042    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620076    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-metrics-client-ca\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620100    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-federate-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620148    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620445 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620187    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8qz\" (UniqueName: \"kubernetes.io/projected/612dea83-31d4-432e-a044-f1e13a3b3bd6-kube-api-access-hn8qz\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.620445 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620216    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.621184 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.620874    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-serving-certs-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.621184 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.621046    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-trusted-ca-bundle\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.621184 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.621120    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/612dea83-31d4-432e-a044-f1e13a3b3bd6-metrics-client-ca\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.623112 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.623064    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-federate-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.623373 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.623331    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.623495 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.623473    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-telemeter-client-tls\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.623534 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.623506    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/612dea83-31d4-432e-a044-f1e13a3b3bd6-secret-telemeter-client\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.632632 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.632595    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8qz\" (UniqueName: \"kubernetes.io/projected/612dea83-31d4-432e-a044-f1e13a3b3bd6-kube-api-access-hn8qz\") pod \"telemeter-client-869cd988bd-fg2pf\" (UID: \"612dea83-31d4-432e-a044-f1e13a3b3bd6\") " pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.729104 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.729064    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf"
Jul 07 17:42:05.890686 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:05.890596    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-869cd988bd-fg2pf"]
Jul 07 17:42:06.061944 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.061752    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:06.150533 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:06.150500    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod612dea83_31d4_432e_a044_f1e13a3b3bd6.slice/crio-12687cc4e01d12b250005f74f1bb7abc3e4f651ce3850368a540e17d767804b3 WatchSource:0}: Error finding container 12687cc4e01d12b250005f74f1bb7abc3e4f651ce3850368a540e17d767804b3: Status 404 returned error can't find the container with id 12687cc4e01d12b250005f74f1bb7abc3e4f651ce3850368a540e17d767804b3
Jul 07 17:42:06.161631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.161600    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:06.364891 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.364858    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:06.495047 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.495011    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:06.895218 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.895177    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"}
Jul 07 17:42:06.895626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.895244    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"}
Jul 07 17:42:06.895626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.895271    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"}
Jul 07 17:42:06.895626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.895296    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"}
Jul 07 17:42:06.895626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.895319    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"}
Jul 07 17:42:06.896263 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:06.896243    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf" event={"ID":"612dea83-31d4-432e-a044-f1e13a3b3bd6","Type":"ContainerStarted","Data":"12687cc4e01d12b250005f74f1bb7abc3e4f651ce3850368a540e17d767804b3"}
Jul 07 17:42:07.229227 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.229194    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:07.231852 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.231825    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.245879 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.245849    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:42:07.249827 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.249796    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:07.335520 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335473    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stdnd\" (UniqueName: \"kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335535    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335562    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335618    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335724    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.335859 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.335828    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436705    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stdnd\" (UniqueName: \"kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436755    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436788    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436808    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436828    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436853    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.436995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.436954    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.437641 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.437611    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.437809 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.437611    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.437947 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.437926    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.438058 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.438038    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.439898 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.439869    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.440069 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.440040    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.445775 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.445736    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-stdnd\" (UniqueName: \"kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd\") pod \"console-75d87fc8d-klrq9\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") " pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.543917 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.543876    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:07.955814 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:07.955787    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:08.056054 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.056030    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:08.075954 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.075920    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:08.086939 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:42:08.086903    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09dd8839_a0d4_4d28_8f91_0723be002606.slice/crio-6c65e2067a119451453ea3268f33cd5bb699a983f22858dc97484abc8641201d WatchSource:0}: Error finding container 6c65e2067a119451453ea3268f33cd5bb699a983f22858dc97484abc8641201d: Status 404 returned error can't find the container with id 6c65e2067a119451453ea3268f33cd5bb699a983f22858dc97484abc8641201d
Jul 07 17:42:08.907027 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.906985    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf" event={"ID":"612dea83-31d4-432e-a044-f1e13a3b3bd6","Type":"ContainerStarted","Data":"7dcb2df4191914af3322d0e30a655b2b3e12707c95e459377a369b2ede67ae1d"}
Jul 07 17:42:08.907302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.907068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf" event={"ID":"612dea83-31d4-432e-a044-f1e13a3b3bd6","Type":"ContainerStarted","Data":"4a9ae034ad5bf28e0f8b516d51ad91ba2241ae509e11aa6f638c9951464008d6"}
Jul 07 17:42:08.907302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.907099    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf" event={"ID":"612dea83-31d4-432e-a044-f1e13a3b3bd6","Type":"ContainerStarted","Data":"d074f2ecced80f964dacaa8e8fd71ed4cf1961c044263f9d3712aff4f64f82d3"}
Jul 07 17:42:08.908649 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.908618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d87fc8d-klrq9" event={"ID":"09dd8839-a0d4-4d28-8f91-0723be002606","Type":"ContainerStarted","Data":"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"}
Jul 07 17:42:08.908751 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.908669    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d87fc8d-klrq9" event={"ID":"09dd8839-a0d4-4d28-8f91-0723be002606","Type":"ContainerStarted","Data":"6c65e2067a119451453ea3268f33cd5bb699a983f22858dc97484abc8641201d"}
Jul 07 17:42:08.911730 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.911704    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerStarted","Data":"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"}
Jul 07 17:42:08.935197 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.935147    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-869cd988bd-fg2pf" podStartSLOduration=2.113675492 podStartE2EDuration="3.935133152s" totalImagesPullingTime="1.82145766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:08.932676143 +0000 UTC m=+83.126169119" watchObservedRunningTime="2026-07-07 17:42:08.935133152 +0000 UTC m=+83.128626128"
Jul 07 17:42:08.970580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.970516    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.684096218 podStartE2EDuration="7.970497277s" totalImagesPullingTime="4.269952397s" totalInitContainerRuntime="16.448662ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:08.970127409 +0000 UTC m=+83.163620396" watchObservedRunningTime="2026-07-07 17:42:08.970497277 +0000 UTC m=+83.163990254"
Jul 07 17:42:08.992355 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:08.992298    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-75d87fc8d-klrq9" podStartSLOduration=1.992276533 podStartE2EDuration="1.992276533s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:08.991733337 +0000 UTC m=+83.185226314" watchObservedRunningTime="2026-07-07 17:42:08.992276533 +0000 UTC m=+83.185769509"
Jul 07 17:42:10.701968 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:10.701931    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:10.702430 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:10.702001    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:10.706871 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:10.706849    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:10.922588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:10.922557    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:11.270956 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:11.270921    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:11.371300 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:11.371269    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:12.158876 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:12.158843    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:12.259114 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:12.259081    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:12.435278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:12.435245    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:12.780808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:12.780710    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8cff7fdd8-wdnqb"
Jul 07 17:42:12.923795 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:12.923733    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:13.025087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:13.025055    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:13.101611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:13.101529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:14.824172 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:14.824135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:14.925513 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:14.925468    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.174844 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.174809    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.275854 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.275822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.557375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.557283    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" podUID="06492315-6039-46b0-b25b-1f4df856078f" containerName="registry" containerID="cri-o://0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb" gracePeriod=30
Jul 07 17:42:15.802546 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.802511    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:42:15.812252 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812185    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812270    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812303    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812347    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812372    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pwnv\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812401    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812420    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812450    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates\") pod \"06492315-6039-46b0-b25b-1f4df856078f\" (UID: \"06492315-6039-46b0-b25b-1f4df856078f\") "
Jul 07 17:42:15.812947 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.812885    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:15.813085 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.813009    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:15.815227 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.815166    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:15.815332 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.815289    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv" (OuterVolumeSpecName: "kube-api-access-2pwnv") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "kube-api-access-2pwnv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:15.815421 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.815399    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:15.815501 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.815455    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:15.815550 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.815522    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:15.821041 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.821014    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "06492315-6039-46b0-b25b-1f4df856078f" (UID: "06492315-6039-46b0-b25b-1f4df856078f"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:15.913225 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913190    2567 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-installation-pull-secrets\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913225 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913223    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pwnv\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-kube-api-access-2pwnv\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913225 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913233    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-trusted-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913241    2567 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/06492315-6039-46b0-b25b-1f4df856078f-ca-trust-extracted\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913251    2567 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/06492315-6039-46b0-b25b-1f4df856078f-registry-certificates\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913259    2567 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-bound-sa-token\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913268    2567 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/06492315-6039-46b0-b25b-1f4df856078f-image-registry-private-configuration\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.913631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.913277    2567 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/06492315-6039-46b0-b25b-1f4df856078f-registry-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:15.943637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.943603    2567 generic.go:356] "Generic (PLEG): container finished" podID="06492315-6039-46b0-b25b-1f4df856078f" containerID="0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb" exitCode=0
Jul 07 17:42:15.943807 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.943651    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6"
Jul 07 17:42:15.943807 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.943671    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" event={"ID":"06492315-6039-46b0-b25b-1f4df856078f","Type":"ContainerDied","Data":"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"}
Jul 07 17:42:15.943807 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.943711    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-78fb494dd6-ksrq6" event={"ID":"06492315-6039-46b0-b25b-1f4df856078f","Type":"ContainerDied","Data":"d2774f4d01ebf396ced6f4ffec943703937ef1a53d30bee7ac28a91b1cb66fbd"}
Jul 07 17:42:15.943807 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.943731    2567 scope.go:117] "RemoveContainer" containerID="0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"
Jul 07 17:42:15.952946 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.952930    2567 scope.go:117] "RemoveContainer" containerID="0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"
Jul 07 17:42:15.953200 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:15.953181    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb\": container with ID starting with 0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb not found: ID does not exist" containerID="0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"
Jul 07 17:42:15.953257 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.953210    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb"} err="failed to get container status \"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb\": rpc error: code = NotFound desc = could not find container \"0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb\": container with ID starting with 0d0ab33d5a582688579a0aa4b20fc5a16bb197b1bac170005b2427372dd97afb not found: ID does not exist"
Jul 07 17:42:15.965640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.965608    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:42:15.970325 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:15.970305    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78fb494dd6-ksrq6"]
Jul 07 17:42:16.387983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:16.387950    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="06492315-6039-46b0-b25b-1f4df856078f" path="/var/lib/kubelet/pods/06492315-6039-46b0-b25b-1f4df856078f/volumes"
Jul 07 17:42:17.544528 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:17.544487    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:18.699222 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:18.699181    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:18.800311 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:18.800270    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.263069 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.263019    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.360416 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.360374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.462840 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.462811    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.633423 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.633337    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:23.753882 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.753852    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.854825 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.854790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:23.921401 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:23.921375    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:31.855211 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:31.855179    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-lwptt"
Jul 07 17:42:33.703351 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:33.703307    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:33.765073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:33.765029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:37.455853 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.455793    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-75d87fc8d-klrq9" podUID="09dd8839-a0d4-4d28-8f91-0723be002606" containerName="console" containerID="cri-o://fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949" gracePeriod=15
Jul 07 17:42:37.762372 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.762341    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:37.906265 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906214    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906265 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906271    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906289    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906335    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906361    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906396    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-stdnd\" (UniqueName: \"kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906475    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config\") pod \"09dd8839-a0d4-4d28-8f91-0723be002606\" (UID: \"09dd8839-a0d4-4d28-8f91-0723be002606\") "
Jul 07 17:42:37.906796 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906709    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca" (OuterVolumeSpecName: "service-ca") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:37.906948 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906845    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:37.906948 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.906841    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:37.907075 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.907011    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config" (OuterVolumeSpecName: "console-config") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:37.908674 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.908636    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:37.908787 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.908701    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd" (OuterVolumeSpecName: "kube-api-access-stdnd") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "kube-api-access-stdnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:37.908787 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:37.908723    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "09dd8839-a0d4-4d28-8f91-0723be002606" (UID: "09dd8839-a0d4-4d28-8f91-0723be002606"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.007946    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-oauth-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.007983    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.007995    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-stdnd\" (UniqueName: \"kubernetes.io/projected/09dd8839-a0d4-4d28-8f91-0723be002606-kube-api-access-stdnd\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.008005    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-console-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.008014    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/09dd8839-a0d4-4d28-8f91-0723be002606-console-oauth-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.008023    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.008040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.008031    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/09dd8839-a0d4-4d28-8f91-0723be002606-trusted-ca-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:38.035330 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.035292    2567 generic.go:356] "Generic (PLEG): container finished" podID="09dd8839-a0d4-4d28-8f91-0723be002606" containerID="fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949" exitCode=0
Jul 07 17:42:38.035490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.035365    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-75d87fc8d-klrq9"
Jul 07 17:42:38.035490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.035386    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d87fc8d-klrq9" event={"ID":"09dd8839-a0d4-4d28-8f91-0723be002606","Type":"ContainerDied","Data":"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"}
Jul 07 17:42:38.035490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.035459    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-75d87fc8d-klrq9" event={"ID":"09dd8839-a0d4-4d28-8f91-0723be002606","Type":"ContainerDied","Data":"6c65e2067a119451453ea3268f33cd5bb699a983f22858dc97484abc8641201d"}
Jul 07 17:42:38.035490 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.035479    2567 scope.go:117] "RemoveContainer" containerID="fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"
Jul 07 17:42:38.044011 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.043995    2567 scope.go:117] "RemoveContainer" containerID="fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"
Jul 07 17:42:38.044273 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:38.044255    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949\": container with ID starting with fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949 not found: ID does not exist" containerID="fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"
Jul 07 17:42:38.044332 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.044281    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949"} err="failed to get container status \"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949\": rpc error: code = NotFound desc = could not find container \"fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949\": container with ID starting with fec8a19a4677c5c2534a9c003dcb14633fa5bc7e190370ddc4ebc68b42369949 not found: ID does not exist"
Jul 07 17:42:38.056253 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.056226    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:38.059596 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.059569    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-75d87fc8d-klrq9"]
Jul 07 17:42:38.386553 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:38.386477    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="09dd8839-a0d4-4d28-8f91-0723be002606" path="/var/lib/kubelet/pods/09dd8839-a0d4-4d28-8f91-0723be002606/volumes"
Jul 07 17:42:41.229064 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:41.229031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.329559 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:41.329527    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:41.386714 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:41.386684    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:48.654333 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:48.654265    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-5645496db4-rl9hc" podUID="2e1385a2-b923-4a04-baf6-97abaa58e07c" containerName="console" containerID="cri-o://ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847" gracePeriod=15
Jul 07 17:42:48.896366 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:48.896341    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:49.008883 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.008838    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jtpd\" (UniqueName: \"kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.008917    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.008953    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.008989    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.009013    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.009059    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert\") pod \"2e1385a2-b923-4a04-baf6-97abaa58e07c\" (UID: \"2e1385a2-b923-4a04-baf6-97abaa58e07c\") "
Jul 07 17:42:49.009416 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.009385    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca" (OuterVolumeSpecName: "service-ca") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:49.009416 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.009394    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config" (OuterVolumeSpecName: "console-config") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:49.009416 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.009408    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:49.011418 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.011381    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:49.011418 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.011411    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd" (OuterVolumeSpecName: "kube-api-access-6jtpd") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "kube-api-access-6jtpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:49.011598 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.011432    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2e1385a2-b923-4a04-baf6-97abaa58e07c" (UID: "2e1385a2-b923-4a04-baf6-97abaa58e07c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:42:49.078819 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.078754    2567 generic.go:356] "Generic (PLEG): container finished" podID="2e1385a2-b923-4a04-baf6-97abaa58e07c" containerID="ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847" exitCode=0
Jul 07 17:42:49.078819 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.078792    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645496db4-rl9hc" event={"ID":"2e1385a2-b923-4a04-baf6-97abaa58e07c","Type":"ContainerDied","Data":"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"}
Jul 07 17:42:49.079015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.078831    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5645496db4-rl9hc"
Jul 07 17:42:49.079015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.078854    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5645496db4-rl9hc" event={"ID":"2e1385a2-b923-4a04-baf6-97abaa58e07c","Type":"ContainerDied","Data":"702fc949c6f6b3f9fba4d4396179e509d1fd1a66148a97526cc10da99d18dfd2"}
Jul 07 17:42:49.079015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.078875    2567 scope.go:117] "RemoveContainer" containerID="ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"
Jul 07 17:42:49.087503 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.087472    2567 scope.go:117] "RemoveContainer" containerID="ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"
Jul 07 17:42:49.087802 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:42:49.087783    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847\": container with ID starting with ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847 not found: ID does not exist" containerID="ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"
Jul 07 17:42:49.087860 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.087811    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847"} err="failed to get container status \"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847\": rpc error: code = NotFound desc = could not find container \"ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847\": container with ID starting with ec371264ac8f2d7cb19a3ae93f3275c6cde957c2e852810831f6f147d5131847 not found: ID does not exist"
Jul 07 17:42:49.100485 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.100460    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:49.104649 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.104629    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5645496db4-rl9hc"]
Jul 07 17:42:49.110589 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110569    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-oauth-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:49.110684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110591    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:49.110684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110605    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-oauth-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:49.110684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110619    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2e1385a2-b923-4a04-baf6-97abaa58e07c-console-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:49.110684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110633    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jtpd\" (UniqueName: \"kubernetes.io/projected/2e1385a2-b923-4a04-baf6-97abaa58e07c-kube-api-access-6jtpd\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:49.110684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:49.110647    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2e1385a2-b923-4a04-baf6-97abaa58e07c-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:42:50.386091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:50.386059    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1385a2-b923-4a04-baf6-97abaa58e07c" path="/var/lib/kubelet/pods/2e1385a2-b923-4a04-baf6-97abaa58e07c/volumes"
Jul 07 17:42:54.098591 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:54.098556    2567 generic.go:356] "Generic (PLEG): container finished" podID="75c1628a-45af-43d3-8441-aab9d31d2a00" containerID="41134713c4de36539fbff17bc5057ce13ae8673d9583454cb1ecc0b1f1305e5e" exitCode=0
Jul 07 17:42:54.098978 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:54.098631    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7" event={"ID":"75c1628a-45af-43d3-8441-aab9d31d2a00","Type":"ContainerDied","Data":"41134713c4de36539fbff17bc5057ce13ae8673d9583454cb1ecc0b1f1305e5e"}
Jul 07 17:42:54.099032 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:54.099015    2567 scope.go:117] "RemoveContainer" containerID="41134713c4de36539fbff17bc5057ce13ae8673d9583454cb1ecc0b1f1305e5e"
Jul 07 17:42:55.104885 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:42:55.104846    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hn9f7" event={"ID":"75c1628a-45af-43d3-8441-aab9d31d2a00","Type":"ContainerStarted","Data":"21dcfb7132eb6baaae1fb4e3761ea2d8a10107a608b63c7591fb3c4011172d50"}
Jul 07 17:43:16.266985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:16.266950    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:16.368232 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:16.368198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:20.552938 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.552901    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:20.553347 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553204    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="alertmanager" containerID="cri-o://807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4" gracePeriod=120
Jul 07 17:43:20.553347 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553292    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-metric" containerID="cri-o://f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f" gracePeriod=120
Jul 07 17:43:20.553347 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553311    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="prom-label-proxy" containerID="cri-o://b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2" gracePeriod=120
Jul 07 17:43:20.553505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553334    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-web" containerID="cri-o://2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81" gracePeriod=120
Jul 07 17:43:20.553505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553366    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="config-reloader" containerID="cri-o://34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e" gracePeriod=120
Jul 07 17:43:20.553505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:20.553363    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy" containerID="cri-o://d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a" gracePeriod=120
Jul 07 17:43:21.203887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.203856    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2" exitCode=0
Jul 07 17:43:21.203887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.203880    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a" exitCode=0
Jul 07 17:43:21.203887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.203888    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e" exitCode=0
Jul 07 17:43:21.203887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.203894    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4" exitCode=0
Jul 07 17:43:21.204200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.203932    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"}
Jul 07 17:43:21.204200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.204013    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"}
Jul 07 17:43:21.204200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.204053    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"}
Jul 07 17:43:21.204200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.204089    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"}
Jul 07 17:43:21.797101 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.797076    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:21.868588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868509    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868584    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jhwrs\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868609    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868629    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868674    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868702    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868758    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868821    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.868895 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868859    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.869607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868919    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.869607 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.868965    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") pod \"7311e5b3-c1b0-4457-a273-aeeefd603351\" (UID: \"7311e5b3-c1b0-4457-a273-aeeefd603351\") "
Jul 07 17:43:21.870078 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.869731    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:21.870397 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.870371    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:43:21.870890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.870862    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:43:21.872594 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.872550    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.872594 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.872565    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:43:21.873190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.873152    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs" (OuterVolumeSpecName: "kube-api-access-jhwrs") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "kube-api-access-jhwrs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:43:21.873611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.873577    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.874016 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.873981    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume" (OuterVolumeSpecName: "config-volume") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.874201 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.874156    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.874435 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.874403    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.874643 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.874615    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out" (OuterVolumeSpecName: "config-out") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:43:21.876987 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.876739    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.883858 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.883831    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config" (OuterVolumeSpecName: "web-config") pod "7311e5b3-c1b0-4457-a273-aeeefd603351" (UID: "7311e5b3-c1b0-4457-a273-aeeefd603351"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:43:21.970402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970364    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-main-db\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970397    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970409    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-main-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970420    2567 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-tls-assets\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970428    2567 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-web-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970436    2567 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-metrics-client-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970445    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970455    2567 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7311e5b3-c1b0-4457-a273-aeeefd603351-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970463    2567 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970471    2567 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-cluster-tls-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970479    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jhwrs\" (UniqueName: \"kubernetes.io/projected/7311e5b3-c1b0-4457-a273-aeeefd603351-kube-api-access-jhwrs\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970487    2567 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/7311e5b3-c1b0-4457-a273-aeeefd603351-config-out\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:21.970629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:21.970494    2567 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/7311e5b3-c1b0-4457-a273-aeeefd603351-config-volume\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:43:22.211119 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211083    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f" exitCode=0
Jul 07 17:43:22.211119 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211109    2567 generic.go:356] "Generic (PLEG): container finished" podID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerID="2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81" exitCode=0
Jul 07 17:43:22.211318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211160    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.211318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211159    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"}
Jul 07 17:43:22.211318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211229    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"}
Jul 07 17:43:22.211318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211256    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"7311e5b3-c1b0-4457-a273-aeeefd603351","Type":"ContainerDied","Data":"177040e814af66d028efcf17cc0199b73e4b760ee414c9732ad130b1db6c2e4d"}
Jul 07 17:43:22.211318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.211286    2567 scope.go:117] "RemoveContainer" containerID="b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"
Jul 07 17:43:22.219571 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.219550    2567 scope.go:117] "RemoveContainer" containerID="f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"
Jul 07 17:43:22.226861 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.226811    2567 scope.go:117] "RemoveContainer" containerID="d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"
Jul 07 17:43:22.234251 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.234228    2567 scope.go:117] "RemoveContainer" containerID="2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"
Jul 07 17:43:22.246572 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.246541    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:22.247222 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.247192    2567 scope.go:117] "RemoveContainer" containerID="34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"
Jul 07 17:43:22.250834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.250812    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:22.255208 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.255191    2567 scope.go:117] "RemoveContainer" containerID="807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"
Jul 07 17:43:22.262482 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.262464    2567 scope.go:117] "RemoveContainer" containerID="8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"
Jul 07 17:43:22.269616 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.269594    2567 scope.go:117] "RemoveContainer" containerID="b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"
Jul 07 17:43:22.269922 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.269901    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2\": container with ID starting with b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2 not found: ID does not exist" containerID="b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"
Jul 07 17:43:22.269969 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.269932    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"} err="failed to get container status \"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2\": rpc error: code = NotFound desc = could not find container \"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2\": container with ID starting with b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2 not found: ID does not exist"
Jul 07 17:43:22.269969 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.269953    2567 scope.go:117] "RemoveContainer" containerID="f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"
Jul 07 17:43:22.270201 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.270184    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f\": container with ID starting with f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f not found: ID does not exist" containerID="f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"
Jul 07 17:43:22.270254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270205    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"} err="failed to get container status \"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f\": rpc error: code = NotFound desc = could not find container \"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f\": container with ID starting with f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f not found: ID does not exist"
Jul 07 17:43:22.270254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270219    2567 scope.go:117] "RemoveContainer" containerID="d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"
Jul 07 17:43:22.270466 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.270451    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a\": container with ID starting with d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a not found: ID does not exist" containerID="d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"
Jul 07 17:43:22.270513 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270468    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"} err="failed to get container status \"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a\": rpc error: code = NotFound desc = could not find container \"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a\": container with ID starting with d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a not found: ID does not exist"
Jul 07 17:43:22.270513 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270480    2567 scope.go:117] "RemoveContainer" containerID="2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"
Jul 07 17:43:22.270668 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.270652    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81\": container with ID starting with 2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81 not found: ID does not exist" containerID="2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"
Jul 07 17:43:22.270707 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270671    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"} err="failed to get container status \"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81\": rpc error: code = NotFound desc = could not find container \"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81\": container with ID starting with 2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81 not found: ID does not exist"
Jul 07 17:43:22.270707 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270685    2567 scope.go:117] "RemoveContainer" containerID="34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"
Jul 07 17:43:22.270947 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.270926    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e\": container with ID starting with 34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e not found: ID does not exist" containerID="34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"
Jul 07 17:43:22.271037 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270951    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"} err="failed to get container status \"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e\": rpc error: code = NotFound desc = could not find container \"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e\": container with ID starting with 34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e not found: ID does not exist"
Jul 07 17:43:22.271037 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.270967    2567 scope.go:117] "RemoveContainer" containerID="807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"
Jul 07 17:43:22.271203 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.271187    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4\": container with ID starting with 807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4 not found: ID does not exist" containerID="807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"
Jul 07 17:43:22.271246 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271207    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"} err="failed to get container status \"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4\": rpc error: code = NotFound desc = could not find container \"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4\": container with ID starting with 807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4 not found: ID does not exist"
Jul 07 17:43:22.271246 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271219    2567 scope.go:117] "RemoveContainer" containerID="8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"
Jul 07 17:43:22.271407 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:43:22.271388    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd\": container with ID starting with 8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd not found: ID does not exist" containerID="8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"
Jul 07 17:43:22.271467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271415    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"} err="failed to get container status \"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd\": rpc error: code = NotFound desc = could not find container \"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd\": container with ID starting with 8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd not found: ID does not exist"
Jul 07 17:43:22.271467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271436    2567 scope.go:117] "RemoveContainer" containerID="b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"
Jul 07 17:43:22.271724 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271706    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2"} err="failed to get container status \"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2\": rpc error: code = NotFound desc = could not find container \"b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2\": container with ID starting with b8e858d5399f302dcfa738ed21991eb18fc1d899dd4d9e1fc2232f556fed40e2 not found: ID does not exist"
Jul 07 17:43:22.271792 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271728    2567 scope.go:117] "RemoveContainer" containerID="f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"
Jul 07 17:43:22.271982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271964    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f"} err="failed to get container status \"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f\": rpc error: code = NotFound desc = could not find container \"f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f\": container with ID starting with f731d089e05270eb595daee6989a2bcf440251c9040be99a9a3025637e70204f not found: ID does not exist"
Jul 07 17:43:22.272030 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.271983    2567 scope.go:117] "RemoveContainer" containerID="d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"
Jul 07 17:43:22.272178 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272161    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a"} err="failed to get container status \"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a\": rpc error: code = NotFound desc = could not find container \"d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a\": container with ID starting with d6b6a5c7be3c6783da408709dc984d5ae4fd631625750830177e73d47e8a067a not found: ID does not exist"
Jul 07 17:43:22.272220 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272178    2567 scope.go:117] "RemoveContainer" containerID="2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"
Jul 07 17:43:22.272387 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272371    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81"} err="failed to get container status \"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81\": rpc error: code = NotFound desc = could not find container \"2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81\": container with ID starting with 2d419b5c3367bd08bde165048b6b1f36aea3ad7a4123257843ccbd2755462c81 not found: ID does not exist"
Jul 07 17:43:22.272426 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272388    2567 scope.go:117] "RemoveContainer" containerID="34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"
Jul 07 17:43:22.272606 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272585    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e"} err="failed to get container status \"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e\": rpc error: code = NotFound desc = could not find container \"34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e\": container with ID starting with 34427a6e322a52cbd1c6aa87103153e5c0efeebdba7c4c2a3f6d61e00365088e not found: ID does not exist"
Jul 07 17:43:22.272606 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272605    2567 scope.go:117] "RemoveContainer" containerID="807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"
Jul 07 17:43:22.272833 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272817    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4"} err="failed to get container status \"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4\": rpc error: code = NotFound desc = could not find container \"807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4\": container with ID starting with 807ea4db3f15e5a790ad648218b80175b93846e90dc898b0658145bfc54ee1b4 not found: ID does not exist"
Jul 07 17:43:22.272886 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.272833    2567 scope.go:117] "RemoveContainer" containerID="8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"
Jul 07 17:43:22.273031 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.273013    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd"} err="failed to get container status \"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd\": rpc error: code = NotFound desc = could not find container \"8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd\": container with ID starting with 8a8cbe2ce7666804fa91188c0b1a356ea76553530dcd0a07a3c10d3a7c73ebcd not found: ID does not exist"
Jul 07 17:43:22.291514 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291483    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:22.291797 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291782    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="06492315-6039-46b0-b25b-1f4df856078f" containerName="registry"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291800    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="06492315-6039-46b0-b25b-1f4df856078f" containerName="registry"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291812    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="config-reloader"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291818    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="config-reloader"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291828    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="init-config-reloader"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291833    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="init-config-reloader"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291838    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291844    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy"
Jul 07 17:43:22.291848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291849    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="prom-label-proxy"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291857    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="prom-label-proxy"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291866    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-web"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291871    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-web"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291878    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-metric"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291883    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-metric"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291895    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e1385a2-b923-4a04-baf6-97abaa58e07c" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291900    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e1385a2-b923-4a04-baf6-97abaa58e07c" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291905    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="alertmanager"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291910    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="alertmanager"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291915    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="09dd8839-a0d4-4d28-8f91-0723be002606" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291920    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="09dd8839-a0d4-4d28-8f91-0723be002606" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291960    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="06492315-6039-46b0-b25b-1f4df856078f" containerName="registry"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291968    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="alertmanager"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291973    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-metric"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291979    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="09dd8839-a0d4-4d28-8f91-0723be002606" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291984    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="config-reloader"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291990    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="prom-label-proxy"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.291996    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy-web"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.292001    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e1385a2-b923-4a04-baf6-97abaa58e07c" containerName="console"
Jul 07 17:43:22.292065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.292005    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" containerName="kube-rbac-proxy"
Jul 07 17:43:22.295811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.295787    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.299009 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.298985    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 07 17:43:22.299347 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.299329    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 07 17:43:22.299729 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.299711    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 07 17:43:22.299729 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.299724    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 07 17:43:22.299898 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.299737    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 07 17:43:22.299898 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.299744    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 07 17:43:22.300065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.300050    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-wxtw5\""
Jul 07 17:43:22.300451 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.300435    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 07 17:43:22.300875 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.300856    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 07 17:43:22.305315 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.305294    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 07 17:43:22.317615 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.317589    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:22.372194 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372150    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372194 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372198    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372220    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nls5p\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-kube-api-access-nls5p\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372311    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372337    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372360    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372402    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372421    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372438    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372454    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.372580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.372477    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.386880 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.386840    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7311e5b3-c1b0-4457-a273-aeeefd603351" path="/var/lib/kubelet/pods/7311e5b3-c1b0-4457-a273-aeeefd603351/volumes"
Jul 07 17:43:22.473367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473323    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473344    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473363    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nls5p\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-kube-api-access-nls5p\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473382    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473408    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473431    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473448    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.473684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.473481    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.474258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.474193    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.474466 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.474402    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.474529 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.474442    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.474669 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.474632    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.474743 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.474718    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.476521 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.476489    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.476728 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.476677    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-web-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.476966 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.476827    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477167    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477195    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477560 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477531    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477584    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477589    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477720 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477678    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-out\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.477856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.477835    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-config-volume\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.478458 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.478443    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.482135 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.482115    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nls5p\" (UniqueName: \"kubernetes.io/projected/a2db4b73-a071-4380-854c-3ef3ef0ce2d8-kube-api-access-nls5p\") pod \"alertmanager-main-0\" (UID: \"a2db4b73-a071-4380-854c-3ef3ef0ce2d8\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.605094 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.605049    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 07 17:43:22.751873 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:22.751841    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 07 17:43:22.753144 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:43:22.753119    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2db4b73_a071_4380_854c_3ef3ef0ce2d8.slice/crio-dde883c46efcd7c03d739768d969fea07e653c68b930afd51d49945efd17cf97 WatchSource:0}: Error finding container dde883c46efcd7c03d739768d969fea07e653c68b930afd51d49945efd17cf97: Status 404 returned error can't find the container with id dde883c46efcd7c03d739768d969fea07e653c68b930afd51d49945efd17cf97
Jul 07 17:43:23.218039 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:23.218004    2567 generic.go:356] "Generic (PLEG): container finished" podID="a2db4b73-a071-4380-854c-3ef3ef0ce2d8" containerID="f4bf1ba83b9cc3172a0b614c1910d6470cbcc0b8a42d7a66b8644313a66441c2" exitCode=0
Jul 07 17:43:23.218514 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:23.218093    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerDied","Data":"f4bf1ba83b9cc3172a0b614c1910d6470cbcc0b8a42d7a66b8644313a66441c2"}
Jul 07 17:43:23.218514 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:23.218165    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"dde883c46efcd7c03d739768d969fea07e653c68b930afd51d49945efd17cf97"}
Jul 07 17:43:24.220734 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.220704    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:43:24.224200 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.224176    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.227045 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227011    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"3eb936f9d758cdfd854f0e9ff00173de9974b9272cfa883f140e34073a2c412d"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"2e0ce043690b1148ea4f055c9210118aa7cde5c785d05f4ce9ef36e6727aa167"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227095    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"3fec1b3154ddb2d68776849bb9208a84ffe0a45d3918ef55f4d34d9e1d640ce9"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227131    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"0c5b04957a68e26b9d2fa0cdc1fe38a2425931c56f3d1fcef7893096bba2b705"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227168    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"6d63ac6185c10ad67167b9630a45958d83dc616b53b12cbc391d4c4364c68884"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227207    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"a2db4b73-a071-4380-854c-3ef3ef0ce2d8","Type":"ContainerStarted","Data":"a3a53b217973aeb9320ca45a83105c496f870b6fd76a4a6afd5390c483b93843"}
Jul 07 17:43:24.227375 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227341    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:43:24.227651 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227346    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:43:24.227651 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227604    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:43:24.227747 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.227648    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:43:24.228816 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.228794    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:43:24.228943 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.228814    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:43:24.229053 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.229033    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l6245\""
Jul 07 17:43:24.230350 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.230330    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:43:24.233709 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.233691    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:43:24.241530 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.241509    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:43:24.289191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289369 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289206    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289369 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289266    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289379    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289411    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289467 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289458    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.289570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.289514    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85mzb\" (UniqueName: \"kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.310874 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.310821    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.295605073 podStartE2EDuration="2.310804149s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.199076ms" isStatefulPod=false podCreationTimestamp="2026-07-07 17:43:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:43:24.309702313 +0000 UTC m=+158.503195288" watchObservedRunningTime="2026-07-07 17:43:24.310804149 +0000 UTC m=+158.504297126"
Jul 07 17:43:24.311974 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.311951    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:24.390558 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390525    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390558 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390558    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390578    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390608    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390623    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390758    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.390829 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.390818    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85mzb\" (UniqueName: \"kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.391469 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.391443    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.391469 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.391455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.391604 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.391455    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.391786 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.391745    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.393868 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.393849    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.393868 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.393859    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.402857 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.402836    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85mzb\" (UniqueName: \"kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb\") pod \"console-7c9c5d746c-pzbml\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") " pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.448137 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.448091    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:24.535013 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.534923    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:24.668167 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:24.667987    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:43:24.670641 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:43:24.670610    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a238bfc_ce71_4c99_8177_8ec3f4a53279.slice/crio-de3eb20f0ad4da906a7dcf51bd8783b350ccd0992f79b34e7fa5540bf399cd41 WatchSource:0}: Error finding container de3eb20f0ad4da906a7dcf51bd8783b350ccd0992f79b34e7fa5540bf399cd41: Status 404 returned error can't find the container with id de3eb20f0ad4da906a7dcf51bd8783b350ccd0992f79b34e7fa5540bf399cd41
Jul 07 17:43:25.233742 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:25.233703    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c5d746c-pzbml" event={"ID":"9a238bfc-ce71-4c99-8177-8ec3f4a53279","Type":"ContainerStarted","Data":"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"}
Jul 07 17:43:25.234171 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:25.233757    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c5d746c-pzbml" event={"ID":"9a238bfc-ce71-4c99-8177-8ec3f4a53279","Type":"ContainerStarted","Data":"de3eb20f0ad4da906a7dcf51bd8783b350ccd0992f79b34e7fa5540bf399cd41"}
Jul 07 17:43:25.252668 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:25.252622    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c9c5d746c-pzbml" podStartSLOduration=1.2526051329999999 podStartE2EDuration="1.252605133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:43:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:43:25.251905617 +0000 UTC m=+159.445398592" watchObservedRunningTime="2026-07-07 17:43:25.252605133 +0000 UTC m=+159.446098108"
Jul 07 17:43:28.200385 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:28.200341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:28.256777 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:28.256737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:33.704158 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:33.704128    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:33.805236 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:33.805189    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:33.886662 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:33.886628    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:34.535210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:34.535159    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:34.535210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:34.535227    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:34.539984 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:34.539962    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:35.276995 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:35.276967    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:43:35.462372 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:35.462327    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:35.563242 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:35.563154    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:35.638319 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:35.638287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:43.044385 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:43:43.044315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:03.101150 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:03.101115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:05.994841 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:05.994800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:06.091351 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.091274    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:06.713404 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.713376    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"]
Jul 07 17:44:06.715626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.715609    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.718162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.718142    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csb86\""
Jul 07 17:44:06.718298 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.718181    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:44:06.719588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.719568    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:44:06.724726 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.724702    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"]
Jul 07 17:44:06.754673 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.754640    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.754877 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.754777    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.754877 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.754850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbhnd\" (UniqueName: \"kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.856224 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.856182    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.856409 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.856251    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.856409 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.856277    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbhnd\" (UniqueName: \"kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.856611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.856588    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.856674 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.856633    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:06.866640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:06.866604    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbhnd\" (UniqueName: \"kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:07.025312 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:07.025219    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:07.159385 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:07.159322    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"]
Jul 07 17:44:07.161431 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:07.161406    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125fcc43_c114_460a_99b6_8ed351fe4d67.slice/crio-47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05 WatchSource:0}: Error finding container 47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05: Status 404 returned error can't find the container with id 47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05
Jul 07 17:44:07.395053 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:07.394968    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h" event={"ID":"125fcc43-c114-460a-99b6-8ed351fe4d67","Type":"ContainerStarted","Data":"47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05"}
Jul 07 17:44:15.867660 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:15.867615    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:17.434889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:17.434850    2567 generic.go:356] "Generic (PLEG): container finished" podID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerID="db35f3eed53effd5b386f1408f319466123a1c1239b37926edc43d685fdb00ae" exitCode=0
Jul 07 17:44:17.435238 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:17.434934    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h" event={"ID":"125fcc43-c114-460a-99b6-8ed351fe4d67","Type":"ContainerDied","Data":"db35f3eed53effd5b386f1408f319466123a1c1239b37926edc43d685fdb00ae"}
Jul 07 17:44:20.447570 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:20.447534    2567 generic.go:356] "Generic (PLEG): container finished" podID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerID="7e259af8525a386d951bc5de8b7249ccf85a96d44cc7a525a21918de602331c4" exitCode=0
Jul 07 17:44:20.448052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:20.447610    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h" event={"ID":"125fcc43-c114-460a-99b6-8ed351fe4d67","Type":"ContainerDied","Data":"7e259af8525a386d951bc5de8b7249ccf85a96d44cc7a525a21918de602331c4"}
Jul 07 17:44:28.484461 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:28.484419    2567 generic.go:356] "Generic (PLEG): container finished" podID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerID="db171337a16738083434ac7f335f7cfa359507796c89cc36d119901da9511a42" exitCode=0
Jul 07 17:44:28.484880 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:28.484504    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h" event={"ID":"125fcc43-c114-460a-99b6-8ed351fe4d67","Type":"ContainerDied","Data":"db171337a16738083434ac7f335f7cfa359507796c89cc36d119901da9511a42"}
Jul 07 17:44:29.659811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.659747    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:29.773359 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.773268    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util\") pod \"125fcc43-c114-460a-99b6-8ed351fe4d67\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") "
Jul 07 17:44:29.773359 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.773313    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbhnd\" (UniqueName: \"kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd\") pod \"125fcc43-c114-460a-99b6-8ed351fe4d67\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") "
Jul 07 17:44:29.773359 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.773354    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle\") pod \"125fcc43-c114-460a-99b6-8ed351fe4d67\" (UID: \"125fcc43-c114-460a-99b6-8ed351fe4d67\") "
Jul 07 17:44:29.774183 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.774108    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle" (OuterVolumeSpecName: "bundle") pod "125fcc43-c114-460a-99b6-8ed351fe4d67" (UID: "125fcc43-c114-460a-99b6-8ed351fe4d67"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:44:29.775724 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.775701    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd" (OuterVolumeSpecName: "kube-api-access-cbhnd") pod "125fcc43-c114-460a-99b6-8ed351fe4d67" (UID: "125fcc43-c114-460a-99b6-8ed351fe4d67"). InnerVolumeSpecName "kube-api-access-cbhnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:44:29.779549 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.779524    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util" (OuterVolumeSpecName: "util") pod "125fcc43-c114-460a-99b6-8ed351fe4d67" (UID: "125fcc43-c114-460a-99b6-8ed351fe4d67"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:44:29.874300 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.874259    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:29.874300 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.874292    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbhnd\" (UniqueName: \"kubernetes.io/projected/125fcc43-c114-460a-99b6-8ed351fe4d67-kube-api-access-cbhnd\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:29.874300 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:29.874302    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/125fcc43-c114-460a-99b6-8ed351fe4d67-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:30.493919 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:30.493887    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h" event={"ID":"125fcc43-c114-460a-99b6-8ed351fe4d67","Type":"ContainerDied","Data":"47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05"}
Jul 07 17:44:30.494077 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:30.493938    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47ee9c844d9d6f278a8eff2f320c121cf043751101d90aa8678d906bf7de9d05"
Jul 07 17:44:30.494077 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:30.493905    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675408gm6h"
Jul 07 17:44:32.965965 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:32.965916    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:33.761969 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:33.761931    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:34.903945 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.903910    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"]
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904187    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="pull"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904199    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="pull"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904210    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="util"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904214    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="util"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904232    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="extract"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904237    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="extract"
Jul 07 17:44:34.904334 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.904285    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="125fcc43-c114-460a-99b6-8ed351fe4d67" containerName="extract"
Jul 07 17:44:34.907322 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.907306    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:34.909911 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.909892    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:44:34.910544 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.910530    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 07 17:44:34.910585 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.910564    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-hks5p\""
Jul 07 17:44:34.923936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:34.923915    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"]
Jul 07 17:44:35.016837 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.016791    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efc78aec-add7-4216-9c3a-d891b5684eb0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.016837 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.016837    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjcg6\" (UniqueName: \"kubernetes.io/projected/efc78aec-add7-4216-9c3a-d891b5684eb0-kube-api-access-vjcg6\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.118165 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.118131    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efc78aec-add7-4216-9c3a-d891b5684eb0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.118312 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.118171    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjcg6\" (UniqueName: \"kubernetes.io/projected/efc78aec-add7-4216-9c3a-d891b5684eb0-kube-api-access-vjcg6\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.118513 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.118492    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/efc78aec-add7-4216-9c3a-d891b5684eb0-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.128215 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.128185    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjcg6\" (UniqueName: \"kubernetes.io/projected/efc78aec-add7-4216-9c3a-d891b5684eb0-kube-api-access-vjcg6\") pod \"cert-manager-operator-controller-manager-55c444bf86-pr9jm\" (UID: \"efc78aec-add7-4216-9c3a-d891b5684eb0\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.215489 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.215460    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"
Jul 07 17:44:35.357254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.357225    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm"]
Jul 07 17:44:35.361295 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:35.361268    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefc78aec_add7_4216_9c3a_d891b5684eb0.slice/crio-9521637f420b7d1b063769b74a69811c1b87c87c52f07d6927827bf4be3f4f0c WatchSource:0}: Error finding container 9521637f420b7d1b063769b74a69811c1b87c87c52f07d6927827bf4be3f4f0c: Status 404 returned error can't find the container with id 9521637f420b7d1b063769b74a69811c1b87c87c52f07d6927827bf4be3f4f0c
Jul 07 17:44:35.514072 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:35.513981    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm" event={"ID":"efc78aec-add7-4216-9c3a-d891b5684eb0","Type":"ContainerStarted","Data":"9521637f420b7d1b063769b74a69811c1b87c87c52f07d6927827bf4be3f4f0c"}
Jul 07 17:44:36.562777 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:36.562704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:36.698573 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:36.698541    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:37.523684 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:37.523642    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm" event={"ID":"efc78aec-add7-4216-9c3a-d891b5684eb0","Type":"ContainerStarted","Data":"6e34b631227d785ab1b80ca17403d522b19df1fec96334d5a4e7fabddf29ab46"}
Jul 07 17:44:37.553168 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:37.553113    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-pr9jm" podStartSLOduration=1.80121265 podStartE2EDuration="3.553092493s" totalImagesPullingTime="1.751879843s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:37.550300483 +0000 UTC m=+231.743793458" watchObservedRunningTime="2026-07-07 17:44:37.553092493 +0000 UTC m=+231.746585468"
Jul 07 17:44:38.105226 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.105196    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:38.292315 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.292280    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:38.626857 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.626825    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"]
Jul 07 17:44:38.629333 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.629316    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.632756 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.632733    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:44:38.632873 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.632784    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csb86\""
Jul 07 17:44:38.633722 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.633702    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:44:38.644588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.644560    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"]
Jul 07 17:44:38.747964 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.747930    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.748150 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.747971    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtfcs\" (UniqueName: \"kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.748150 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.748045    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.830137 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.830102    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:38.849231 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.849198    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.849367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.849239    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtfcs\" (UniqueName: \"kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.849367 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.849266    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.849605 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.849587    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.849638 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.849613    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.858831 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.858803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtfcs\" (UniqueName: \"kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:38.932330 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.932275    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:38.938116 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:38.938090    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:39.081036 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:39.081003    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"]
Jul 07 17:44:39.084261 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:39.084233    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b57c526_b4a0_4b2f_ae5b_48866468c427.slice/crio-d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196 WatchSource:0}: Error finding container d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196: Status 404 returned error can't find the container with id d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196
Jul 07 17:44:39.533122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:39.533041    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerID="4128d3de5852401d496f2da1b22286184c1ea94e675065acaf3989df2f8e9b20" exitCode=0
Jul 07 17:44:39.533122 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:39.533109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh" event={"ID":"2b57c526-b4a0-4b2f-ae5b-48866468c427","Type":"ContainerDied","Data":"4128d3de5852401d496f2da1b22286184c1ea94e675065acaf3989df2f8e9b20"}
Jul 07 17:44:39.533502 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:39.533147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh" event={"ID":"2b57c526-b4a0-4b2f-ae5b-48866468c427","Type":"ContainerStarted","Data":"d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196"}
Jul 07 17:44:40.871747 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:40.871711    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:41.257950 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.257904    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:41.358713 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.358680    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdfr2"]
Jul 07 17:44:41.366534 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.366502    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.370115 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.369986    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 17:44:41.370115 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.369999    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 17:44:41.370115 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.370021    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-r6k9d\""
Jul 07 17:44:41.371076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.371053    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdfr2"]
Jul 07 17:44:41.473602 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.473567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.473792 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.473616    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nngpd\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-kube-api-access-nngpd\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.574318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.574291    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.574377 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.574353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nngpd\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-kube-api-access-nngpd\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.583567 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.583541    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.583740 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.583717    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nngpd\" (UniqueName: \"kubernetes.io/projected/247aee57-8bf7-40e7-b269-60bf28fdc687-kube-api-access-nngpd\") pod \"cert-manager-webhook-6486ffd997-jdfr2\" (UID: \"247aee57-8bf7-40e7-b269-60bf28fdc687\") " pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.685924 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.685891    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:44:41.818537 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:41.818515    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-jdfr2"]
Jul 07 17:44:41.820675 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:41.820648    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod247aee57_8bf7_40e7_b269_60bf28fdc687.slice/crio-8c06c0b8819fe41ffdcabc18ca8e5b6860ba82a2f2faadb424fde1a79fcd1287 WatchSource:0}: Error finding container 8c06c0b8819fe41ffdcabc18ca8e5b6860ba82a2f2faadb424fde1a79fcd1287: Status 404 returned error can't find the container with id 8c06c0b8819fe41ffdcabc18ca8e5b6860ba82a2f2faadb424fde1a79fcd1287
Jul 07 17:44:42.547116 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:42.547078    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2" event={"ID":"247aee57-8bf7-40e7-b269-60bf28fdc687","Type":"ContainerStarted","Data":"8c06c0b8819fe41ffdcabc18ca8e5b6860ba82a2f2faadb424fde1a79fcd1287"}
Jul 07 17:44:42.548839 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:42.548817    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerID="4e929aa803f5fc180eda1c6d99c874a75d4f0e165c84072c2d696d9b89f7a98f" exitCode=0
Jul 07 17:44:42.548960 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:42.548898    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh" event={"ID":"2b57c526-b4a0-4b2f-ae5b-48866468c427","Type":"ContainerDied","Data":"4e929aa803f5fc180eda1c6d99c874a75d4f0e165c84072c2d696d9b89f7a98f"}
Jul 07 17:44:43.297018 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:43.296988    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:43.398084 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:43.398047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:43.556575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:43.556494    2567 generic.go:356] "Generic (PLEG): container finished" podID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerID="1ea1383163cfc9fcf0ccac9be04d86bc9a465371fdfbad03578e06d8322a25df" exitCode=0
Jul 07 17:44:43.556945 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:43.556580    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh" event={"ID":"2b57c526-b4a0-4b2f-ae5b-48866468c427","Type":"ContainerDied","Data":"1ea1383163cfc9fcf0ccac9be04d86bc9a465371fdfbad03578e06d8322a25df"}
Jul 07 17:44:44.683394 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.683368    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:44.803360 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.803333    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util\") pod \"2b57c526-b4a0-4b2f-ae5b-48866468c427\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") "
Jul 07 17:44:44.803518 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.803369    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle\") pod \"2b57c526-b4a0-4b2f-ae5b-48866468c427\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") "
Jul 07 17:44:44.803518 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.803410    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wtfcs\" (UniqueName: \"kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs\") pod \"2b57c526-b4a0-4b2f-ae5b-48866468c427\" (UID: \"2b57c526-b4a0-4b2f-ae5b-48866468c427\") "
Jul 07 17:44:44.803857 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.803821    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle" (OuterVolumeSpecName: "bundle") pod "2b57c526-b4a0-4b2f-ae5b-48866468c427" (UID: "2b57c526-b4a0-4b2f-ae5b-48866468c427"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:44:44.805582 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.805560    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs" (OuterVolumeSpecName: "kube-api-access-wtfcs") pod "2b57c526-b4a0-4b2f-ae5b-48866468c427" (UID: "2b57c526-b4a0-4b2f-ae5b-48866468c427"). InnerVolumeSpecName "kube-api-access-wtfcs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:44:44.809561 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.809513    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util" (OuterVolumeSpecName: "util") pod "2b57c526-b4a0-4b2f-ae5b-48866468c427" (UID: "2b57c526-b4a0-4b2f-ae5b-48866468c427"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:44:44.904612 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.904568    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:44.904612 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.904605    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2b57c526-b4a0-4b2f-ae5b-48866468c427-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:44.904612 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:44.904615    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wtfcs\" (UniqueName: \"kubernetes.io/projected/2b57c526-b4a0-4b2f-ae5b-48866468c427-kube-api-access-wtfcs\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:44:45.566732 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:45.566700    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh" event={"ID":"2b57c526-b4a0-4b2f-ae5b-48866468c427","Type":"ContainerDied","Data":"d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196"}
Jul 07 17:44:45.566891 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:45.566736    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87ftchnh"
Jul 07 17:44:45.566891 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:45.566746    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d9165a732a2c13587fcec55895d643ddabf0c7805062d255bc31c35de54c7196"
Jul 07 17:44:49.306550 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:49.306513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:49.430721 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:49.430683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:49.530325 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:49.530294    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:50.219783 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.219727    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-chf6w"]
Jul 07 17:44:50.220110 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220092    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="util"
Jul 07 17:44:50.220191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220114    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="util"
Jul 07 17:44:50.220191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220145    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="pull"
Jul 07 17:44:50.220191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220153    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="pull"
Jul 07 17:44:50.220191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220166    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="extract"
Jul 07 17:44:50.220191 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220175    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="extract"
Jul 07 17:44:50.220411 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.220254    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b57c526-b4a0-4b2f-ae5b-48866468c427" containerName="extract"
Jul 07 17:44:50.222318 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.222295    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.224616 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.224593    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-tdd76\""
Jul 07 17:44:50.231512 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.231491    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-chf6w"]
Jul 07 17:44:50.246214 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.246190    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcd55\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-kube-api-access-pcd55\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.246331 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.246223    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.346778 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.346733    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcd55\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-kube-api-access-pcd55\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.347247 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.346790    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.355661 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.355632    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-bound-sa-token\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.355858 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.355840    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcd55\" (UniqueName: \"kubernetes.io/projected/223847c8-7306-4fb6-8f4a-69272395f5d2-kube-api-access-pcd55\") pod \"cert-manager-55b4d954d5-chf6w\" (UID: \"223847c8-7306-4fb6-8f4a-69272395f5d2\") " pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.531620 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.531524    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-chf6w"
Jul 07 17:44:50.668645 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:50.668620    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-chf6w"]
Jul 07 17:44:50.670401 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:50.670375    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod223847c8_7306_4fb6_8f4a_69272395f5d2.slice/crio-52e2034ccc9280b199f122d8871b05b9047fc330070c3418b5dd8ff7278dd055 WatchSource:0}: Error finding container 52e2034ccc9280b199f122d8871b05b9047fc330070c3418b5dd8ff7278dd055: Status 404 returned error can't find the container with id 52e2034ccc9280b199f122d8871b05b9047fc330070c3418b5dd8ff7278dd055
Jul 07 17:44:51.290062 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:51.289997    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:51.596812 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:51.596718    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-chf6w" event={"ID":"223847c8-7306-4fb6-8f4a-69272395f5d2","Type":"ContainerStarted","Data":"52e2034ccc9280b199f122d8871b05b9047fc330070c3418b5dd8ff7278dd055"}
Jul 07 17:44:53.607305 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:53.607268    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-chf6w" event={"ID":"223847c8-7306-4fb6-8f4a-69272395f5d2","Type":"ContainerStarted","Data":"22912ef7bb0a1f47a235e1522c8ddc8b025db8779090e9e5fc7d7093b319149f"}
Jul 07 17:44:53.624113 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:53.624066    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-chf6w" podStartSLOduration=1.221690395 podStartE2EDuration="3.624050936s" totalImagesPullingTime="2.402360541s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:44:53.62291067 +0000 UTC m=+247.816403658" watchObservedRunningTime="2026-07-07 17:44:53.624050936 +0000 UTC m=+247.817543911"
Jul 07 17:44:55.836130 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:55.836093    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:55.927822 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:55.927788    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:57.869083 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:57.869047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:58.985776 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:58.985727    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"]
Jul 07 17:44:59.008955 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.008921    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"]
Jul 07 17:44:59.008955 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.008938    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.011741 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.011720    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 07 17:44:59.012753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.012734    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-csb86\""
Jul 07 17:44:59.012847 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.012790    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 07 17:44:59.114242 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.114207    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.114414 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.114261    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.114414 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.114312    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghqf6\" (UniqueName: \"kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.215631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.215588    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.215824 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.215643    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghqf6\" (UniqueName: \"kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.215824 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.215717    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.216015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.215996    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.216063 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.216043    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.225194 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.225166    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghqf6\" (UniqueName: \"kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.319392 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.319307    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:44:59.473899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.473872    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"]
Jul 07 17:44:59.476203 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:44:59.476167    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda42aab70_e666_4d09_8079_117add5e4ad3.slice/crio-673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006 WatchSource:0}: Error finding container 673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006: Status 404 returned error can't find the container with id 673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006
Jul 07 17:44:59.633970 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.633939    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerStarted","Data":"4332a7d51df5bf1230647b85627e9fec3e9554d9fb397b917d8cef785a24ee3d"}
Jul 07 17:44:59.634127 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:44:59.633991    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerStarted","Data":"673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006"}
Jul 07 17:45:00.639437 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:00.639351    2567 generic.go:356] "Generic (PLEG): container finished" podID="a42aab70-e666-4d09-8079-117add5e4ad3" containerID="4332a7d51df5bf1230647b85627e9fec3e9554d9fb397b917d8cef785a24ee3d" exitCode=0
Jul 07 17:45:00.639437 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:00.639405    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerDied","Data":"4332a7d51df5bf1230647b85627e9fec3e9554d9fb397b917d8cef785a24ee3d"}
Jul 07 17:45:01.645108 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:01.645028    2567 generic.go:356] "Generic (PLEG): container finished" podID="a42aab70-e666-4d09-8079-117add5e4ad3" containerID="1fd8c84254128f05b5d6a151dd93ba588c92a9b5006083674a65aaae2eacfbb8" exitCode=0
Jul 07 17:45:01.645108 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:01.645068    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerDied","Data":"1fd8c84254128f05b5d6a151dd93ba588c92a9b5006083674a65aaae2eacfbb8"}
Jul 07 17:45:02.651545 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:02.651508    2567 generic.go:356] "Generic (PLEG): container finished" podID="a42aab70-e666-4d09-8079-117add5e4ad3" containerID="2070ecaf04b662e895f947d1f22ebc084f0d267ef82647a1eed33309816258bc" exitCode=0
Jul 07 17:45:02.651903 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:02.651558    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerDied","Data":"2070ecaf04b662e895f947d1f22ebc084f0d267ef82647a1eed33309816258bc"}
Jul 07 17:45:03.781209 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.781182    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:45:03.856295 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.856265    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util\") pod \"a42aab70-e666-4d09-8079-117add5e4ad3\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") "
Jul 07 17:45:03.856485 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.856309    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle\") pod \"a42aab70-e666-4d09-8079-117add5e4ad3\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") "
Jul 07 17:45:03.856485 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.856380    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ghqf6\" (UniqueName: \"kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6\") pod \"a42aab70-e666-4d09-8079-117add5e4ad3\" (UID: \"a42aab70-e666-4d09-8079-117add5e4ad3\") "
Jul 07 17:45:03.857212 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.857179    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle" (OuterVolumeSpecName: "bundle") pod "a42aab70-e666-4d09-8079-117add5e4ad3" (UID: "a42aab70-e666-4d09-8079-117add5e4ad3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:45:03.858526 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.858504    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6" (OuterVolumeSpecName: "kube-api-access-ghqf6") pod "a42aab70-e666-4d09-8079-117add5e4ad3" (UID: "a42aab70-e666-4d09-8079-117add5e4ad3"). InnerVolumeSpecName "kube-api-access-ghqf6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:45:03.861725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.861679    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util" (OuterVolumeSpecName: "util") pod "a42aab70-e666-4d09-8079-117add5e4ad3" (UID: "a42aab70-e666-4d09-8079-117add5e4ad3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:45:03.957725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.957690    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:45:03.957725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.957719    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a42aab70-e666-4d09-8079-117add5e4ad3-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:45:03.957725 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:03.957729    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ghqf6\" (UniqueName: \"kubernetes.io/projected/a42aab70-e666-4d09-8079-117add5e4ad3-kube-api-access-ghqf6\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:45:04.662678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:04.662613    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh"
Jul 07 17:45:04.662678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:04.662645    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796affg8zh" event={"ID":"a42aab70-e666-4d09-8079-117add5e4ad3","Type":"ContainerDied","Data":"673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006"}
Jul 07 17:45:04.662872 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:04.662688    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="673cac145d9eb2ccd51b600402194da9deb57c1378288a2acc704abb4d3eb006"
Jul 07 17:45:09.747023 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:09.746944    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:09.889980 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:09.889936    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.378658 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.378624    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.709717 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.709679    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.838631 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.838589    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"]
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839041    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="util"
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839060    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="util"
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839069    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="extract"
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839077    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="extract"
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839098    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="pull"
Jul 07 17:45:10.839107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839106    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="pull"
Jul 07 17:45:10.839398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.839216    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a42aab70-e666-4d09-8079-117add5e4ad3" containerName="extract"
Jul 07 17:45:10.841402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.841381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:10.844268 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.844250    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:45:10.844528 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.844509    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:45:10.844636 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.844610    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-lvxjn\""
Jul 07 17:45:10.844814 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.844801    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:45:10.844892 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.844876    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:45:10.852326 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.852304    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.860625 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.860602    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"]
Jul 07 17:45:10.918000 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.917966    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:10.918177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.918027    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:10.918177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.918067    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:10.918177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.918094    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:10.918177 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:10.918119    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ql454\" (UniqueName: \"kubernetes.io/projected/5450e2a0-22e5-434f-a380-5dfaa3caacae-kube-api-access-ql454\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.016249 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.016166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.019371 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019353    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.019423 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019409    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.019456 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019440    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.019509 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019493    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.019646 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ql454\" (UniqueName: \"kubernetes.io/projected/5450e2a0-22e5-434f-a380-5dfaa3caacae-kube-api-access-ql454\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.019834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.019811    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-manifests\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.022019 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.021992    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5450e2a0-22e5-434f-a380-5dfaa3caacae-tmp\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.022138 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.022121    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-apiservice-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.022243 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.022227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/5450e2a0-22e5-434f-a380-5dfaa3caacae-webhook-cert\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.030230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.030199    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ql454\" (UniqueName: \"kubernetes.io/projected/5450e2a0-22e5-434f-a380-5dfaa3caacae-kube-api-access-ql454\") pod \"opendatahub-operator-controller-manager-d698b7b5d-wp984\" (UID: \"5450e2a0-22e5-434f-a380-5dfaa3caacae\") " pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.114788 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.114734    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.152031 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.151995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:11.231924 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.231892    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.314361 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.314281    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"]
Jul 07 17:45:11.318750 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:45:11.318709    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5450e2a0_22e5_434f_a380_5dfaa3caacae.slice/crio-c946cc59b1af40dbb731b606bb1e782e508d1316569ffc75d3266e11f76244a8 WatchSource:0}: Error finding container c946cc59b1af40dbb731b606bb1e782e508d1316569ffc75d3266e11f76244a8: Status 404 returned error can't find the container with id c946cc59b1af40dbb731b606bb1e782e508d1316569ffc75d3266e11f76244a8
Jul 07 17:45:11.381271 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.381238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.479803 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.479758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:11.693134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:11.693105    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984" event={"ID":"5450e2a0-22e5-434f-a380-5dfaa3caacae","Type":"ContainerStarted","Data":"c946cc59b1af40dbb731b606bb1e782e508d1316569ffc75d3266e11f76244a8"}
Jul 07 17:45:13.706254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:13.706219    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2" event={"ID":"247aee57-8bf7-40e7-b269-60bf28fdc687","Type":"ContainerStarted","Data":"f47a98ac89df7156d6cbbd9361446350d26ad429429cd38a360ea734ae2e13db"}
Jul 07 17:45:13.706721 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:13.706284    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:45:14.712044 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:14.712007    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984" event={"ID":"5450e2a0-22e5-434f-a380-5dfaa3caacae","Type":"ContainerStarted","Data":"a6e28d69f27110a17fd559e9cc66a6fb6b5c282af3019af980bf5c2599c11330"}
Jul 07 17:45:14.743985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:14.743884    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2" podStartSLOduration=2.086963091 podStartE2EDuration="33.743868038s" totalImagesPullingTime="31.656904947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:44:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:13.732238501 +0000 UTC m=+267.925731478" watchObservedRunningTime="2026-07-07 17:45:14.743868038 +0000 UTC m=+268.937361014"
Jul 07 17:45:15.717973 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:15.717938    2567 generic.go:356] "Generic (PLEG): container finished" podID="5450e2a0-22e5-434f-a380-5dfaa3caacae" containerID="a6e28d69f27110a17fd559e9cc66a6fb6b5c282af3019af980bf5c2599c11330" exitCode=0
Jul 07 17:45:15.718449 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:15.717983    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984" event={"ID":"5450e2a0-22e5-434f-a380-5dfaa3caacae","Type":"ContainerDied","Data":"a6e28d69f27110a17fd559e9cc66a6fb6b5c282af3019af980bf5c2599c11330"}
Jul 07 17:45:16.339284 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:16.339194    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:16.600934 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:16.600856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:16.725536 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:16.725503    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984" event={"ID":"5450e2a0-22e5-434f-a380-5dfaa3caacae","Type":"ContainerStarted","Data":"5879777e9989f390a7e3b59fea66e9de6046d91a8190bf4267f46d3f9ac09d01"}
Jul 07 17:45:16.726023 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:16.725638    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:16.769073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:16.769009    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984" podStartSLOduration=2.202477624 podStartE2EDuration="6.76899333s" totalImagesPullingTime="3.524268501s" totalInitContainerRuntime="1.042247205s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:16.766373491 +0000 UTC m=+270.959866480" watchObservedRunningTime="2026-07-07 17:45:16.76899333 +0000 UTC m=+270.962486347"
Jul 07 17:45:19.714243 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:19.714210    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-jdfr2"
Jul 07 17:45:21.502207 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:21.502176    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:21.580949 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:21.580913    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:26.418059 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:26.418010    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:26.520650 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:26.520616    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:27.732751 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:27.732720    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-d698b7b5d-wp984"
Jul 07 17:45:28.456563 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.456521    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"]
Jul 07 17:45:28.462038 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.462020    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.465509 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.465483    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 07 17:45:28.467594 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.467577    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:45:28.467715 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.467590    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:45:28.467715 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.467649    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 07 17:45:28.467838 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.467726    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 07 17:45:28.467892 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.467848    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-jlmhz\""
Jul 07 17:45:28.482518 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.482492    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"]
Jul 07 17:45:28.576621 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.576573    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2wqr\" (UniqueName: \"kubernetes.io/projected/425b600b-2793-411e-803d-80f0958056db-kube-api-access-k2wqr\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.576856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.576655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.576856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.576711    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425b600b-2793-411e-803d-80f0958056db-manager-config\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.576856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.576799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.677888 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.677840    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425b600b-2793-411e-803d-80f0958056db-manager-config\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.677888 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.677897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.678107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.677923    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2wqr\" (UniqueName: \"kubernetes.io/projected/425b600b-2793-411e-803d-80f0958056db-kube-api-access-k2wqr\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.678107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.677975    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.678543 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.678519    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/425b600b-2793-411e-803d-80f0958056db-manager-config\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.680494 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.680475    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.680614 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.680596    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/425b600b-2793-411e-803d-80f0958056db-metrics-cert\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.687682 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.687657    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2wqr\" (UniqueName: \"kubernetes.io/projected/425b600b-2793-411e-803d-80f0958056db-kube-api-access-k2wqr\") pod \"lws-controller-manager-85d9cbc876-9wh57\" (UID: \"425b600b-2793-411e-803d-80f0958056db\") " pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.770973 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.770888    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:28.911398 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:28.911373    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"]
Jul 07 17:45:28.913749 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:45:28.913724    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod425b600b_2793_411e_803d_80f0958056db.slice/crio-e2ca8c561a63113a897e96299bdb331d71db2108ab9ffd5b4b45ace9bed1b697 WatchSource:0}: Error finding container e2ca8c561a63113a897e96299bdb331d71db2108ab9ffd5b4b45ace9bed1b697: Status 404 returned error can't find the container with id e2ca8c561a63113a897e96299bdb331d71db2108ab9ffd5b4b45ace9bed1b697
Jul 07 17:45:29.787487 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:29.787452    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57" event={"ID":"425b600b-2793-411e-803d-80f0958056db","Type":"ContainerStarted","Data":"e2ca8c561a63113a897e96299bdb331d71db2108ab9ffd5b4b45ace9bed1b697"}
Jul 07 17:45:31.089434 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.089402    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:31.256686 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.256650    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:31.710426 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.710392    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:31.799566 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.799527    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57" event={"ID":"425b600b-2793-411e-803d-80f0958056db","Type":"ContainerStarted","Data":"22f0d425424cc66ec1f7304f88d0231af028b03d73172169c052360c34c033a7"}
Jul 07 17:45:31.799739 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.799649    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:31.857225 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.857144    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57" podStartSLOduration=1.901005874 podStartE2EDuration="3.857123121s" totalImagesPullingTime="1.956117247s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:31.855491154 +0000 UTC m=+286.048984131" watchObservedRunningTime="2026-07-07 17:45:31.857123121 +0000 UTC m=+286.050616098"
Jul 07 17:45:31.860461 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.860432    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:31.978985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:31.978893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.058578 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.058544    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.160971 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.160937    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.289278 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.289187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.426923 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.426889    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.718611 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.718567    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:32.951000 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:32.950954    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:33.816357 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:33.816323    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:33.889743 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:33.889704    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:34.896357 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:34.896323    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:39.214947 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.214910    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:39.316160 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.316119    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:39.895257 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.895222    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"]
Jul 07 17:45:39.898127 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.898110    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:39.935699 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.935662    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 17:45:39.935699 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.935700    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 17:45:39.936651 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.936634    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jmpgc\""
Jul 07 17:45:39.936890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.936877    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:45:39.947546 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.947528    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:45:39.957101 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.957079    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:45:39.965632 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:39.965609    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 17:45:40.016073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.016037    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"]
Jul 07 17:45:40.079505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pqhl\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-kube-api-access-2pqhl\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079505 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079501    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079533    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079554    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079584    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079600    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.079753 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.079628    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.180900 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.180869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.180908    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.180931    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.180946    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181103 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.180966    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.181104    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pqhl\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-kube-api-access-2pqhl\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181302 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.181149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.181566 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.181538    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.183558 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.183531    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.183658 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.183637    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.183856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.183841    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.183914 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.183899    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.195590 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.195568    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pqhl\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-kube-api-access-2pqhl\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.200710 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.200654    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d26f1587-52a4-4fd6-ba8d-4b3aba444dac-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-p8f24\" (UID: \"d26f1587-52a4-4fd6-ba8d-4b3aba444dac\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.207519 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.207501    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:40.353333 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.353300    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"]
Jul 07 17:45:40.356308 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:45:40.356280    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd26f1587_52a4_4fd6_ba8d_4b3aba444dac.slice/crio-ad025ed70a070df10ca19a074a6007458a650e33522a161247d3970a4b305b9b WatchSource:0}: Error finding container ad025ed70a070df10ca19a074a6007458a650e33522a161247d3970a4b305b9b: Status 404 returned error can't find the container with id ad025ed70a070df10ca19a074a6007458a650e33522a161247d3970a4b305b9b
Jul 07 17:45:40.740066 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.740039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:40.844936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:40.844896    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24" event={"ID":"d26f1587-52a4-4fd6-ba8d-4b3aba444dac","Type":"ContainerStarted","Data":"ad025ed70a070df10ca19a074a6007458a650e33522a161247d3970a4b305b9b"}
Jul 07 17:45:41.013154 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:41.013066    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:41.282475 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:41.282359    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:42.750473 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.750439    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 17:45:42.750720 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.750507    2567 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"}
Jul 07 17:45:42.806510 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.806488    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-85d9cbc876-9wh57"
Jul 07 17:45:42.858380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.858338    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24" event={"ID":"d26f1587-52a4-4fd6-ba8d-4b3aba444dac","Type":"ContainerStarted","Data":"719d544a55b1fc7e7e860418fa6807adff8d23f7112211a8aa49e1d0ce5f9448"}
Jul 07 17:45:42.858780 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.858735    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:45:42.898106 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:42.898053    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24" podStartSLOduration=1.5060900830000001 podStartE2EDuration="3.898035355s" totalImagesPullingTime="2.391945272s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:45:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:45:42.896627434 +0000 UTC m=+297.090120402" watchObservedRunningTime="2026-07-07 17:45:42.898035355 +0000 UTC m=+297.091528331"
Jul 07 17:45:43.865418 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:43.865373    2567 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-p8f24 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:45:43.865809 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:43.865455    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24" podUID="d26f1587-52a4-4fd6-ba8d-4b3aba444dac" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:45:44.390515 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:44.390468    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:44.689945 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:44.689911    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:44.895748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:44.895718    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:45.085537 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:45.085447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:46.061425 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.061392    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:46.196964 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.196929    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:46.236934 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.236903    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:45:46.240858 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.240837    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:45:46.241647 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.241627    2567 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:45:46.379686 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.379499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:46.865277 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:45:46.865246    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-p8f24"
Jul 07 17:46:32.533988 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:32.533956    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:33.969453 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:33.969390    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:44.684785 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.684678    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"]
Jul 07 17:46:44.687961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.687944    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.691171 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.691148    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:46:44.691329 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.691312    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zbn5v\""
Jul 07 17:46:44.692215 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.692199    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:46:44.697926 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.697902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"]
Jul 07 17:46:44.744107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.744072    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6n64\" (UniqueName: \"kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.744287 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.744121    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.744287 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.744190    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.845447 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.845404    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.845628 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.845526    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6n64\" (UniqueName: \"kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.845628 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.845569    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.845949 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.845927    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.846010 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.845937    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.856259 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.856231    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6n64\" (UniqueName: \"kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:44.998568 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:44.998475    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:45.137982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.137941    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"]
Jul 07 17:46:45.143318 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:46:45.143282    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd8bc6e0_e4bf_4e9a_beb2_42908831da89.slice/crio-04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63 WatchSource:0}: Error finding container 04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63: Status 404 returned error can't find the container with id 04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63
Jul 07 17:46:45.285865 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.285834    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"]
Jul 07 17:46:45.289275 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.289252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.299659 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.299629    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"]
Jul 07 17:46:45.349754 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.349714    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.349945 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.349753    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkmgw\" (UniqueName: \"kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.349945 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.349838    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.450965 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.450930    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.451128 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.450974    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkmgw\" (UniqueName: \"kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.451190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.451114    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.451495 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.451474    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.451559 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.451528    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.461618 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.461593    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkmgw\" (UniqueName: \"kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.608682 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.608585    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:45.744848 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.744826    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"]
Jul 07 17:46:45.747471 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:46:45.747435    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod707b4c7b_5173_4c2a_9efb_a2b6c658de5d.slice/crio-b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e WatchSource:0}: Error finding container b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e: Status 404 returned error can't find the container with id b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e
Jul 07 17:46:45.885124 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.885051    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"]
Jul 07 17:46:45.888202 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.888184    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:45.899246 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.899215    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"]
Jul 07 17:46:45.955449 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.955417    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:45.955612 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.955456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcqrx\" (UniqueName: \"kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:45.955612 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:45.955496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.057010 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.056969    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.057010 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.057013    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcqrx\" (UniqueName: \"kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.057239 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.057057    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.057457 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.057436    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.057494 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.057448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.066804 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.066759    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcqrx\" (UniqueName: \"kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.151719 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.151637    2567 generic.go:356] "Generic (PLEG): container finished" podID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerID="052ffaed5db4fb0cf4601c712646d720a7882bfa9679be8057f12e44d86e3241" exitCode=0
Jul 07 17:46:46.151719 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.151710    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552" event={"ID":"707b4c7b-5173-4c2a-9efb-a2b6c658de5d","Type":"ContainerDied","Data":"052ffaed5db4fb0cf4601c712646d720a7882bfa9679be8057f12e44d86e3241"}
Jul 07 17:46:46.151983 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.151749    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552" event={"ID":"707b4c7b-5173-4c2a-9efb-a2b6c658de5d","Type":"ContainerStarted","Data":"b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e"}
Jul 07 17:46:46.152304 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.152285    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:46:46.153431 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.153408    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerID="0a065dfa80db660064f1187bf01bdcd49d7d76f0d663fed9244b5d6064b55432" exitCode=0
Jul 07 17:46:46.153510 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.153446    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db" event={"ID":"cd8bc6e0-e4bf-4e9a-beb2-42908831da89","Type":"ContainerDied","Data":"0a065dfa80db660064f1187bf01bdcd49d7d76f0d663fed9244b5d6064b55432"}
Jul 07 17:46:46.153510 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.153480    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db" event={"ID":"cd8bc6e0-e4bf-4e9a-beb2-42908831da89","Type":"ContainerStarted","Data":"04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63"}
Jul 07 17:46:46.229610 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.229575    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:46.368065 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.367997    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"]
Jul 07 17:46:46.371806 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:46:46.371747    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72d1c5d5_17d4_4ae5_b5be_cda29ff77ce0.slice/crio-1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500 WatchSource:0}: Error finding container 1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500: Status 404 returned error can't find the container with id 1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500
Jul 07 17:46:46.481100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.481074    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"]
Jul 07 17:46:46.484891 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.484868    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.493980 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.493954    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"]
Jul 07 17:46:46.561525 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.561491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.561525 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.561529    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbvgr\" (UniqueName: \"kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.561750 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.561655    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.663079 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.662996    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.663079 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.663065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.663296 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.663093    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbvgr\" (UniqueName: \"kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.663397 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.663331    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.663397 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.663364    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.673308 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.673280    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbvgr\" (UniqueName: \"kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:46.835268 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:46.835233    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:47.028010 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.027981    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"]
Jul 07 17:46:47.031544 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:46:47.031393    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45d7c42_a08b_4653_b454_c6a0872d1d27.slice/crio-b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5 WatchSource:0}: Error finding container b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5: Status 404 returned error can't find the container with id b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5
Jul 07 17:46:47.159493 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.159469    2567 generic.go:356] "Generic (PLEG): container finished" podID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerID="926802dc9d5d61735f7f74f30045f68c99b083716899421d8f50b8921361a685" exitCode=0
Jul 07 17:46:47.159629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.159551    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j" event={"ID":"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0","Type":"ContainerDied","Data":"926802dc9d5d61735f7f74f30045f68c99b083716899421d8f50b8921361a685"}
Jul 07 17:46:47.159629 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.159606    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j" event={"ID":"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0","Type":"ContainerStarted","Data":"1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500"}
Jul 07 17:46:47.160941 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.160910    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2" event={"ID":"b45d7c42-a08b-4653-b454-c6a0872d1d27","Type":"ContainerStarted","Data":"b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5"}
Jul 07 17:46:47.162972 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.162952    2567 generic.go:356] "Generic (PLEG): container finished" podID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerID="7229943dfdd13ac0db456c0e2388535f2518f2bc44c81750cedf1f3d7b156a96" exitCode=0
Jul 07 17:46:47.163075 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.163021    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552" event={"ID":"707b4c7b-5173-4c2a-9efb-a2b6c658de5d","Type":"ContainerDied","Data":"7229943dfdd13ac0db456c0e2388535f2518f2bc44c81750cedf1f3d7b156a96"}
Jul 07 17:46:47.165052 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.165025    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerID="170db85dae77ae315dbd5ef5b2f13f9c6d7f2469727b8d20198a51911f05e15c" exitCode=0
Jul 07 17:46:47.165158 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:47.165074    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db" event={"ID":"cd8bc6e0-e4bf-4e9a-beb2-42908831da89","Type":"ContainerDied","Data":"170db85dae77ae315dbd5ef5b2f13f9c6d7f2469727b8d20198a51911f05e15c"}
Jul 07 17:46:47.222183 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:46:47.222159    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45d7c42_a08b_4653_b454_c6a0872d1d27.slice/crio-476efd88eb552aa4a3383152191c72adb9d10881fe80fa5ec1f30ecffa19144f.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 17:46:48.172039 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.172005    2567 generic.go:356] "Generic (PLEG): container finished" podID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerID="a01be71969e0b61d77727d2053e1a285f634cd2c517c98ebc20365d773585a39" exitCode=0
Jul 07 17:46:48.172423 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.172087    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552" event={"ID":"707b4c7b-5173-4c2a-9efb-a2b6c658de5d","Type":"ContainerDied","Data":"a01be71969e0b61d77727d2053e1a285f634cd2c517c98ebc20365d773585a39"}
Jul 07 17:46:48.174047 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.174019    2567 generic.go:356] "Generic (PLEG): container finished" podID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerID="8f957d721fa87a9377d6c54f481e895db578894b2a4466ec32ee74ccd4ceb4a8" exitCode=0
Jul 07 17:46:48.174162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.174109    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db" event={"ID":"cd8bc6e0-e4bf-4e9a-beb2-42908831da89","Type":"ContainerDied","Data":"8f957d721fa87a9377d6c54f481e895db578894b2a4466ec32ee74ccd4ceb4a8"}
Jul 07 17:46:48.175751 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.175729    2567 generic.go:356] "Generic (PLEG): container finished" podID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerID="ba5823fcc05a93ffbd9c53baeec13f7f69fd2f25787ab56ab9a9bb72d1432e1b" exitCode=0
Jul 07 17:46:48.175855 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.175789    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j" event={"ID":"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0","Type":"ContainerDied","Data":"ba5823fcc05a93ffbd9c53baeec13f7f69fd2f25787ab56ab9a9bb72d1432e1b"}
Jul 07 17:46:48.186622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.186588    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2" event={"ID":"b45d7c42-a08b-4653-b454-c6a0872d1d27","Type":"ContainerDied","Data":"476efd88eb552aa4a3383152191c72adb9d10881fe80fa5ec1f30ecffa19144f"}
Jul 07 17:46:48.186622 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:48.186605    2567 generic.go:356] "Generic (PLEG): container finished" podID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerID="476efd88eb552aa4a3383152191c72adb9d10881fe80fa5ec1f30ecffa19144f" exitCode=0
Jul 07 17:46:49.193476 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.193386    2567 generic.go:356] "Generic (PLEG): container finished" podID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerID="cd48571edb93c4d32aa7e38ee7f35e6542fad4b12882480fd50a4837cb04b9e3" exitCode=0
Jul 07 17:46:49.193948 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.193473    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2" event={"ID":"b45d7c42-a08b-4653-b454-c6a0872d1d27","Type":"ContainerDied","Data":"cd48571edb93c4d32aa7e38ee7f35e6542fad4b12882480fd50a4837cb04b9e3"}
Jul 07 17:46:49.195816 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.195793    2567 generic.go:356] "Generic (PLEG): container finished" podID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerID="06b67443f9ded1450599a87433d8efb744346564efcbbcd9b9157f5adce8b1f5" exitCode=0
Jul 07 17:46:49.195913 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.195858    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j" event={"ID":"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0","Type":"ContainerDied","Data":"06b67443f9ded1450599a87433d8efb744346564efcbbcd9b9157f5adce8b1f5"}
Jul 07 17:46:49.336291 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.336258    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:49.352912 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.352884    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:49.388729 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.388701    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6n64\" (UniqueName: \"kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64\") pod \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") "
Jul 07 17:46:49.388925 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.388755    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util\") pod \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") "
Jul 07 17:46:49.388925 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.388850    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle\") pod \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\" (UID: \"cd8bc6e0-e4bf-4e9a-beb2-42908831da89\") "
Jul 07 17:46:49.389495 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.389464    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle" (OuterVolumeSpecName: "bundle") pod "cd8bc6e0-e4bf-4e9a-beb2-42908831da89" (UID: "cd8bc6e0-e4bf-4e9a-beb2-42908831da89"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:49.391369 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.391344    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64" (OuterVolumeSpecName: "kube-api-access-x6n64") pod "cd8bc6e0-e4bf-4e9a-beb2-42908831da89" (UID: "cd8bc6e0-e4bf-4e9a-beb2-42908831da89"). InnerVolumeSpecName "kube-api-access-x6n64". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:46:49.394774 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.394735    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util" (OuterVolumeSpecName: "util") pod "cd8bc6e0-e4bf-4e9a-beb2-42908831da89" (UID: "cd8bc6e0-e4bf-4e9a-beb2-42908831da89"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:49.489834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.489726    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkmgw\" (UniqueName: \"kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw\") pod \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") "
Jul 07 17:46:49.489834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.489804    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle\") pod \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") "
Jul 07 17:46:49.489834 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.489835    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util\") pod \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\" (UID: \"707b4c7b-5173-4c2a-9efb-a2b6c658de5d\") "
Jul 07 17:46:49.490209 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.490187    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6n64\" (UniqueName: \"kubernetes.io/projected/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-kube-api-access-x6n64\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:49.490209 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.490207    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:49.490209 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.490217    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cd8bc6e0-e4bf-4e9a-beb2-42908831da89-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:49.490453 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.490381    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle" (OuterVolumeSpecName: "bundle") pod "707b4c7b-5173-4c2a-9efb-a2b6c658de5d" (UID: "707b4c7b-5173-4c2a-9efb-a2b6c658de5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:49.492076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.492054    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw" (OuterVolumeSpecName: "kube-api-access-jkmgw") pod "707b4c7b-5173-4c2a-9efb-a2b6c658de5d" (UID: "707b4c7b-5173-4c2a-9efb-a2b6c658de5d"). InnerVolumeSpecName "kube-api-access-jkmgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:46:49.495419 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.495391    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util" (OuterVolumeSpecName: "util") pod "707b4c7b-5173-4c2a-9efb-a2b6c658de5d" (UID: "707b4c7b-5173-4c2a-9efb-a2b6c658de5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:49.591337 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.591284    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkmgw\" (UniqueName: \"kubernetes.io/projected/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-kube-api-access-jkmgw\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:49.591337 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.591327    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:49.591337 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:49.591338    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/707b4c7b-5173-4c2a-9efb-a2b6c658de5d-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:50.202904 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.202867    2567 generic.go:356] "Generic (PLEG): container finished" podID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerID="0d88dee5611102be4a9ac55f727fe43861603554e9b19b33d54910950f791929" exitCode=0
Jul 07 17:46:50.203330 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.202959    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2" event={"ID":"b45d7c42-a08b-4653-b454-c6a0872d1d27","Type":"ContainerDied","Data":"0d88dee5611102be4a9ac55f727fe43861603554e9b19b33d54910950f791929"}
Jul 07 17:46:50.204776 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.204739    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552" event={"ID":"707b4c7b-5173-4c2a-9efb-a2b6c658de5d","Type":"ContainerDied","Data":"b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e"}
Jul 07 17:46:50.204776 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.204754    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552"
Jul 07 17:46:50.204920 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.204796    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b67293fa73de24f24592c24753769257160f8897c7ad90c20dd9caeb45852f7e"
Jul 07 17:46:50.206541 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.206521    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db" event={"ID":"cd8bc6e0-e4bf-4e9a-beb2-42908831da89","Type":"ContainerDied","Data":"04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63"}
Jul 07 17:46:50.206626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.206548    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db"
Jul 07 17:46:50.206626 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.206553    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04ab08c36b229923f21225c08e12af0b23b5f5200d38f90dd92fb05d6fd02a63"
Jul 07 17:46:50.343325 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.343296    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:50.398936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.398904    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle\") pod \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") "
Jul 07 17:46:50.399067 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.398953    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcqrx\" (UniqueName: \"kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx\") pod \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") "
Jul 07 17:46:50.399067 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.399054    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util\") pod \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\" (UID: \"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0\") "
Jul 07 17:46:50.399445 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.399423    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle" (OuterVolumeSpecName: "bundle") pod "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" (UID: "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:50.401348 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.401325    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx" (OuterVolumeSpecName: "kube-api-access-vcqrx") pod "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" (UID: "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0"). InnerVolumeSpecName "kube-api-access-vcqrx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:46:50.404731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.404705    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util" (OuterVolumeSpecName: "util") pod "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" (UID: "72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:50.500569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.500458    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:50.500569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.500492    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcqrx\" (UniqueName: \"kubernetes.io/projected/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-kube-api-access-vcqrx\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:50.500569 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:50.500506    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:51.218222 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.218189    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j"
Jul 07 17:46:51.218222 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.218214    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j" event={"ID":"72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0","Type":"ContainerDied","Data":"1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500"}
Jul 07 17:46:51.218907 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.218291    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d7f3c4de4161b46d299a3016dc2ed803583408c30efbecc6f2fbf004f54d500"
Jul 07 17:46:51.349568 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.349543    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:51.408143 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.408107    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle\") pod \"b45d7c42-a08b-4653-b454-c6a0872d1d27\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") "
Jul 07 17:46:51.408297 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.408158    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sbvgr\" (UniqueName: \"kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr\") pod \"b45d7c42-a08b-4653-b454-c6a0872d1d27\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") "
Jul 07 17:46:51.408297 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.408220    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util\") pod \"b45d7c42-a08b-4653-b454-c6a0872d1d27\" (UID: \"b45d7c42-a08b-4653-b454-c6a0872d1d27\") "
Jul 07 17:46:51.408679 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.408651    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle" (OuterVolumeSpecName: "bundle") pod "b45d7c42-a08b-4653-b454-c6a0872d1d27" (UID: "b45d7c42-a08b-4653-b454-c6a0872d1d27"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:51.410391 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.410355    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr" (OuterVolumeSpecName: "kube-api-access-sbvgr") pod "b45d7c42-a08b-4653-b454-c6a0872d1d27" (UID: "b45d7c42-a08b-4653-b454-c6a0872d1d27"). InnerVolumeSpecName "kube-api-access-sbvgr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:46:51.413651 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.413624    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util" (OuterVolumeSpecName: "util") pod "b45d7c42-a08b-4653-b454-c6a0872d1d27" (UID: "b45d7c42-a08b-4653-b454-c6a0872d1d27"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:46:51.509388 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.509279    2567 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-util\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:51.509388 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.509322    2567 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45d7c42-a08b-4653-b454-c6a0872d1d27-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:51.509388 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:51.509335    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sbvgr\" (UniqueName: \"kubernetes.io/projected/b45d7c42-a08b-4653-b454-c6a0872d1d27-kube-api-access-sbvgr\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:46:52.224981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:52.224946    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2" event={"ID":"b45d7c42-a08b-4653-b454-c6a0872d1d27","Type":"ContainerDied","Data":"b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5"}
Jul 07 17:46:52.224981 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:52.224980    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2"
Jul 07 17:46:52.225429 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:52.224996    2567 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b84503832cfae50e5406f561513b284a223b1c02bfa4f1d788861e5661655aa5"
Jul 07 17:46:58.350575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:46:58.350536    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:01.848124 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:01.848088    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:03.379040 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:03.379001    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:03.793422 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:03.793394    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:04.603073 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:04.603013    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:06.557308 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:06.557266    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:08.565442 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:08.565389    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:08.842280 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:08.842187    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:11.235427 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:11.235372    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:12.626890 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:12.626861    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:12.687882 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:12.687829    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:13.173835 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.173801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:13.262740 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.262697    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:13.395013 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.394984    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-77b87f95c8-rnc8h"]
Jul 07 17:47:13.395306 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395294    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="util"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395308    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="util"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395317    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="extract"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395323    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="extract"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395329    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="extract"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395335    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="extract"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395342    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="pull"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395347    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="pull"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395360    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="util"
Jul 07 17:47:13.395389 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395391    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="util"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395400    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="util"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395405    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="util"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395413    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395421    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395431    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395436    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395442    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395447    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395452    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395457    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="pull"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395465    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="util"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395470    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="util"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395483    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395491    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395556    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="707b4c7b-5173-4c2a-9efb-a2b6c658de5d" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395564    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45d7c42-a08b-4653-b454-c6a0872d1d27" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395572    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0" containerName="extract"
Jul 07 17:47:13.395637 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.395579    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="cd8bc6e0-e4bf-4e9a-beb2-42908831da89" containerName="extract"
Jul 07 17:47:13.398531 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.398515    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.416878 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.416844    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b87f95c8-rnc8h"]
Jul 07 17:47:13.504546 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-oauth-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504546 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504496    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq29d\" (UniqueName: \"kubernetes.io/projected/5250a2f2-851f-489b-960f-67d3bd599a25-kube-api-access-wq29d\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504546 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504526    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504576    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-console-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504637    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-oauth-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504681    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-service-ca\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.504808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.504752    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-trusted-ca-bundle\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.574012 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.573982    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:13.605864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.605831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-trusted-ca-bundle\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.605990 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.605897    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-oauth-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.605990 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.605922    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq29d\" (UniqueName: \"kubernetes.io/projected/5250a2f2-851f-489b-960f-67d3bd599a25-kube-api-access-wq29d\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.606135 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606085    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.606135 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606132    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-console-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.606230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606149    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-oauth-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.606230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606166    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-service-ca\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.606710 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606681    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-oauth-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.607016 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606803    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-trusted-ca-bundle\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.607016 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.606850    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-console-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.607134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.607085    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/5250a2f2-851f-489b-960f-67d3bd599a25-service-ca\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.608748 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.608727    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-serving-cert\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.608876 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.608748    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/5250a2f2-851f-489b-960f-67d3bd599a25-console-oauth-config\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.619818 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.619741    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq29d\" (UniqueName: \"kubernetes.io/projected/5250a2f2-851f-489b-960f-67d3bd599a25-kube-api-access-wq29d\") pod \"console-77b87f95c8-rnc8h\" (UID: \"5250a2f2-851f-489b-960f-67d3bd599a25\") " pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.698927 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.698892    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:13.706944 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.706918    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:13.847252 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:13.847221    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-77b87f95c8-rnc8h"]
Jul 07 17:47:13.852452 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:47:13.852426    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5250a2f2_851f_489b_960f_67d3bd599a25.slice/crio-10801a089b0d56800aab25a8d88e9c7b42a485d1bc27d1f2c2fa545a2b0703b1 WatchSource:0}: Error finding container 10801a089b0d56800aab25a8d88e9c7b42a485d1bc27d1f2c2fa545a2b0703b1: Status 404 returned error can't find the container with id 10801a089b0d56800aab25a8d88e9c7b42a485d1bc27d1f2c2fa545a2b0703b1
Jul 07 17:47:14.334561 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:14.334529    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b87f95c8-rnc8h" event={"ID":"5250a2f2-851f-489b-960f-67d3bd599a25","Type":"ContainerStarted","Data":"afa08be1c37338b3bbf8878feb18f521664f695fa1c8ac0056a265f76fe16128"}
Jul 07 17:47:14.334758 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:14.334577    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-77b87f95c8-rnc8h" event={"ID":"5250a2f2-851f-489b-960f-67d3bd599a25","Type":"ContainerStarted","Data":"10801a089b0d56800aab25a8d88e9c7b42a485d1bc27d1f2c2fa545a2b0703b1"}
Jul 07 17:47:14.357440 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:14.357366    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-77b87f95c8-rnc8h" podStartSLOduration=1.357342443 podStartE2EDuration="1.357342443s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:47:14.357006041 +0000 UTC m=+388.550499018" watchObservedRunningTime="2026-07-07 17:47:14.357342443 +0000 UTC m=+388.550835421"
Jul 07 17:47:22.267861 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:22.267819    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:22.362997 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:22.362961    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:23.707816 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:23.707781    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:23.708266 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:23.707845    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:23.712744 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:23.712718    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:24.392382 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:24.392347    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-77b87f95c8-rnc8h"
Jul 07 17:47:24.470801 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:24.470753    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:47:24.693586 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:24.693549    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:24.846904 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:24.846869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:25.106902 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:25.106807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:29.484831 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:29.484797    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:29.590184 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:29.590141    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:31.029533 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:31.029491    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:33.219514 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:33.219478    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:33.330674 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:33.330631    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:42.090233 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:42.090199    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:42.327867 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:42.327833    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:44.461210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:44.461177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:44.571511 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:44.571476    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:49.193853 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.193817    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:49.348655 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.348612    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:49.492050 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.491966    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c9c5d746c-pzbml" podUID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" containerName="console" containerID="cri-o://6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce" gracePeriod=15
Jul 07 17:47:49.741178 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.741150    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:47:49.825134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825045    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825086    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825130    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-85mzb\" (UniqueName: \"kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825165    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825192    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825258    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825402 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825319    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert\") pod \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\" (UID: \"9a238bfc-ce71-4c99-8177-8ec3f4a53279\") "
Jul 07 17:47:49.825652 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825604    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:47:49.825843 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825646    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca" (OuterVolumeSpecName: "service-ca") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:47:49.825843 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825697    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:47:49.825969 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.825927    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config" (OuterVolumeSpecName: "console-config") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:47:49.827537 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.827508    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:47:49.827620 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.827545    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:47:49.827620 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.827585    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb" (OuterVolumeSpecName: "kube-api-access-85mzb") pod "9a238bfc-ce71-4c99-8177-8ec3f4a53279" (UID: "9a238bfc-ce71-4c99-8177-8ec3f4a53279"). InnerVolumeSpecName "kube-api-access-85mzb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:47:49.926994 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.926939    2567 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-trusted-ca-bundle\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.926994 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.926985    2567 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.926994 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.926996    2567 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.926994 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.927004    2567 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.926994 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.927013    2567 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9a238bfc-ce71-4c99-8177-8ec3f4a53279-oauth-serving-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.927304 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.927024    2567 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9a238bfc-ce71-4c99-8177-8ec3f4a53279-console-oauth-config\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:49.927304 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:49.927032    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-85mzb\" (UniqueName: \"kubernetes.io/projected/9a238bfc-ce71-4c99-8177-8ec3f4a53279-kube-api-access-85mzb\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:47:50.519678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.519645    2567 generic.go:356] "Generic (PLEG): container finished" podID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" containerID="6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce" exitCode=0
Jul 07 17:47:50.520081 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.519695    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c9c5d746c-pzbml"
Jul 07 17:47:50.520081 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.519731    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c5d746c-pzbml" event={"ID":"9a238bfc-ce71-4c99-8177-8ec3f4a53279","Type":"ContainerDied","Data":"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"}
Jul 07 17:47:50.520081 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.519803    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c9c5d746c-pzbml" event={"ID":"9a238bfc-ce71-4c99-8177-8ec3f4a53279","Type":"ContainerDied","Data":"de3eb20f0ad4da906a7dcf51bd8783b350ccd0992f79b34e7fa5540bf399cd41"}
Jul 07 17:47:50.520081 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.519826    2567 scope.go:117] "RemoveContainer" containerID="6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"
Jul 07 17:47:50.528587 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.528571    2567 scope.go:117] "RemoveContainer" containerID="6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"
Jul 07 17:47:50.528892 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:47:50.528869    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce\": container with ID starting with 6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce not found: ID does not exist" containerID="6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"
Jul 07 17:47:50.528954 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.528902    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce"} err="failed to get container status \"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce\": rpc error: code = NotFound desc = could not find container \"6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce\": container with ID starting with 6ee7af1b4aa81cfae4b3b0d8c208a8fbf90e0b8e78bcb5a38b4e7ee1dd77efce not found: ID does not exist"
Jul 07 17:47:50.546343 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.546314    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:47:50.551097 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:50.551074    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c9c5d746c-pzbml"]
Jul 07 17:47:52.387371 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:52.387338    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" path="/var/lib/kubelet/pods/9a238bfc-ce71-4c99-8177-8ec3f4a53279/volumes"
Jul 07 17:47:52.658532 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:52.658441    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:52.864183 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:52.864140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:53.354296 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:53.354263    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:53.659371 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:53.659287    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:55.757977 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:55.757938    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:55.908755 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:55.908718    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:56.778336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:56.778305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:56.919352 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:56.919316    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:57.937579 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.937544    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:47:57.937985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.937887    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" containerName="console"
Jul 07 17:47:57.937985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.937900    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" containerName="console"
Jul 07 17:47:57.937985 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.937966    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a238bfc-ce71-4c99-8177-8ec3f4a53279" containerName="console"
Jul 07 17:47:57.942193 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.942173    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:57.946538 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.946501    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:47:57.946678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.946544    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:47:57.946678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.946585    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 17:47:57.947603 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.947587    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zbn5v\""
Jul 07 17:47:57.965673 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.965623    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:57.971487 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:57.971460    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:47:58.023788 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.023744    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:47:58.103178 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.103138    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.103368 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.103210    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xg96m\" (UniqueName: \"kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.205156 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.205068    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.205456 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.205433    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xg96m\" (UniqueName: \"kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.206387 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.206353    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.223255 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.223222    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xg96m\" (UniqueName: \"kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m\") pod \"limitador-limitador-64c94fd64f-r6qpz\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.252143 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.252105    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:47:58.412518 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.412493    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:47:58.413469 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:47:58.413439    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b9ea850_c7ae_4b51_b525_3b469a3cfd30.slice/crio-a7ce70b1e2db7e761547c940b8113664c676ca57dbd10e291f6efc9cea70127e WatchSource:0}: Error finding container a7ce70b1e2db7e761547c940b8113664c676ca57dbd10e291f6efc9cea70127e: Status 404 returned error can't find the container with id a7ce70b1e2db7e761547c940b8113664c676ca57dbd10e291f6efc9cea70127e
Jul 07 17:47:58.562295 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:47:58.562217    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" event={"ID":"7b9ea850-c7ae-4b51-b525-3b469a3cfd30","Type":"ContainerStarted","Data":"a7ce70b1e2db7e761547c940b8113664c676ca57dbd10e291f6efc9cea70127e"}
Jul 07 17:48:01.579189 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:01.579147    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" event={"ID":"7b9ea850-c7ae-4b51-b525-3b469a3cfd30","Type":"ContainerStarted","Data":"58972d8828c49dc59eb108209b82f36cd2595cb36a8b177e5600f9887c592ed9"}
Jul 07 17:48:01.579614 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:01.579280    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:48:01.847046 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:01.846940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:01.984085 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:01.984051    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:04.294932 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:04.294900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:04.396510 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:04.396479    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:09.041416 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:09.041322    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:09.302952 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:09.302869    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:12.585542 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:12.585506    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:48:12.611174 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:12.610437    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" podStartSLOduration=12.870668711 podStartE2EDuration="15.610413296s" totalImagesPullingTime="2.739744585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:47:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:01.610335232 +0000 UTC m=+435.803828207" watchObservedRunningTime="2026-07-07 17:48:12.610413296 +0000 UTC m=+446.803906273"
Jul 07 17:48:15.025015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:15.024976    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:48:15.025432 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:15.025179    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" podUID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" containerName="limitador" containerID="cri-o://58972d8828c49dc59eb108209b82f36cd2595cb36a8b177e5600f9887c592ed9" gracePeriod=30
Jul 07 17:48:15.648279 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:15.648195    2567 generic.go:356] "Generic (PLEG): container finished" podID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" containerID="58972d8828c49dc59eb108209b82f36cd2595cb36a8b177e5600f9887c592ed9" exitCode=0
Jul 07 17:48:15.648279 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:15.648270    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" event={"ID":"7b9ea850-c7ae-4b51-b525-3b469a3cfd30","Type":"ContainerDied","Data":"58972d8828c49dc59eb108209b82f36cd2595cb36a8b177e5600f9887c592ed9"}
Jul 07 17:48:15.981936 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:15.981911    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:48:16.044111 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.044078    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file\") pod \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") "
Jul 07 17:48:16.044111 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.044119    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xg96m\" (UniqueName: \"kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m\") pod \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\" (UID: \"7b9ea850-c7ae-4b51-b525-3b469a3cfd30\") "
Jul 07 17:48:16.044518 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.044465    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file" (OuterVolumeSpecName: "config-file") pod "7b9ea850-c7ae-4b51-b525-3b469a3cfd30" (UID: "7b9ea850-c7ae-4b51-b525-3b469a3cfd30"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:48:16.046476 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.046452    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m" (OuterVolumeSpecName: "kube-api-access-xg96m") pod "7b9ea850-c7ae-4b51-b525-3b469a3cfd30" (UID: "7b9ea850-c7ae-4b51-b525-3b469a3cfd30"). InnerVolumeSpecName "kube-api-access-xg96m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:16.144950 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.144919    2567 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-config-file\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:48:16.144950 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.144946    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xg96m\" (UniqueName: \"kubernetes.io/projected/7b9ea850-c7ae-4b51-b525-3b469a3cfd30-kube-api-access-xg96m\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:48:16.638857 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.638813    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:16.654580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.654492    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"
Jul 07 17:48:16.654580 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.654536    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r6qpz" event={"ID":"7b9ea850-c7ae-4b51-b525-3b469a3cfd30","Type":"ContainerDied","Data":"a7ce70b1e2db7e761547c940b8113664c676ca57dbd10e291f6efc9cea70127e"}
Jul 07 17:48:16.654835 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.654591    2567 scope.go:117] "RemoveContainer" containerID="58972d8828c49dc59eb108209b82f36cd2595cb36a8b177e5600f9887c592ed9"
Jul 07 17:48:16.682665 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.682634    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:48:16.687707 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.687681    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r6qpz"]
Jul 07 17:48:16.759923 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:16.759888    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:17.119653 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.119620    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"]
Jul 07 17:48:17.120030 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.119971    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" containerName="limitador"
Jul 07 17:48:17.120030 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.119983    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" containerName="limitador"
Jul 07 17:48:17.120099 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.120041    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" containerName="limitador"
Jul 07 17:48:17.124219 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.124201    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.126723 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.126700    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-6r7sx\""
Jul 07 17:48:17.126910 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.126703    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 07 17:48:17.127712 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.127694    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 07 17:48:17.127823 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.127724    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 07 17:48:17.133506 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.133481    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"]
Jul 07 17:48:17.154666 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.153558    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-data\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.154666 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.153615    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwjkg\" (UniqueName: \"kubernetes.io/projected/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-kube-api-access-lwjkg\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.180461 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.180429    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:17.254619 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.254583    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-data\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.254619 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.254626    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwjkg\" (UniqueName: \"kubernetes.io/projected/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-kube-api-access-lwjkg\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.255026 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.255005    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-data\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.277323 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.277286    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwjkg\" (UniqueName: \"kubernetes.io/projected/5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05-kube-api-access-lwjkg\") pod \"postgres-69fb4594cf-fgsqp\" (UID: \"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.434048 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.434017    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:17.579154 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.579120    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"]
Jul 07 17:48:17.581705 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:48:17.581673    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d32f8e2_c6b9_4d7f_932b_ab7104a1cd05.slice/crio-0e49db99d54675d7db87c3d06433e85dc5988c86122e87f920189c3eed9d1f87 WatchSource:0}: Error finding container 0e49db99d54675d7db87c3d06433e85dc5988c86122e87f920189c3eed9d1f87: Status 404 returned error can't find the container with id 0e49db99d54675d7db87c3d06433e85dc5988c86122e87f920189c3eed9d1f87
Jul 07 17:48:17.660719 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:17.660684    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp" event={"ID":"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05","Type":"ContainerStarted","Data":"0e49db99d54675d7db87c3d06433e85dc5988c86122e87f920189c3eed9d1f87"}
Jul 07 17:48:18.387576 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:18.387544    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b9ea850-c7ae-4b51-b525-3b469a3cfd30" path="/var/lib/kubelet/pods/7b9ea850-c7ae-4b51-b525-3b469a3cfd30/volumes"
Jul 07 17:48:23.698424 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:23.698381    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp" event={"ID":"5d32f8e2-c6b9-4d7f-932b-ab7104a1cd05","Type":"ContainerStarted","Data":"efbf60558263e7343c76587fa4f4565dc50f868671bf5695559cd94867d5d922"}
Jul 07 17:48:23.698801 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:23.698488    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:23.773077 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:23.772968    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp" podStartSLOduration=0.832347279 podStartE2EDuration="6.772947457s" totalImagesPullingTime="5.940600178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:23.771030404 +0000 UTC m=+457.964523385" watchObservedRunningTime="2026-07-07 17:48:23.772947457 +0000 UTC m=+457.966440431"
Jul 07 17:48:29.737739 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:29.737706    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-fgsqp"
Jul 07 17:48:30.092643 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:30.092552    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:30.563655 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:30.563619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:37.763249 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.763213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:37.839074 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.839041    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:37.841237 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.841222    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:37.844204 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.844183    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6w4gr\""
Jul 07 17:48:37.844330 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.844291    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:48:37.845105 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.845091    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:48:37.908899 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.908864    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:37.942477 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.942446    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:37.942706 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:37.942575    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klzpk\" (UniqueName: \"kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.043545 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.043450    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klzpk\" (UniqueName: \"kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.043545 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.043523    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.046262 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.046229    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.055716 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.055688    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-klzpk\" (UniqueName: \"kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk\") pod \"maas-controller-67d99b66d4-jwmmm\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") " pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.089160 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.089124    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:38.142162 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.142122    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:48:38.144575 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.144559    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.153018 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.152995    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:38.166251 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.166222    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:48:38.244466 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.244429    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.244621 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.244491    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqhc8\" (UniqueName: \"kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.263704 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.263605    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:38.325138 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.325116    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:38.327232 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:48:38.327198    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd31226a6_4676_45a5_b0e4_23260d0dd0ee.slice/crio-fe7232d7b47c460988409ce14fa9b12f2def0f8ae5bdbf9395b3cd0f5f0b3cdc WatchSource:0}: Error finding container fe7232d7b47c460988409ce14fa9b12f2def0f8ae5bdbf9395b3cd0f5f0b3cdc: Status 404 returned error can't find the container with id fe7232d7b47c460988409ce14fa9b12f2def0f8ae5bdbf9395b3cd0f5f0b3cdc
Jul 07 17:48:38.345047 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.345020    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.345201 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.345064    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqhc8\" (UniqueName: \"kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.347678 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.347659    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.355651 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.355633    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqhc8\" (UniqueName: \"kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8\") pod \"maas-controller-75b964f5f4-5n2kd\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") " pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.455134 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.455096    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:38.624748 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:48:38.624723    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50b56b5b_2006_4ac1_84ce_95b5b6636c43.slice/crio-54de4eaef4796952de78a8cf1b8782ba6c6b52876a097fd8e34e8be08b1958e9 WatchSource:0}: Error finding container 54de4eaef4796952de78a8cf1b8782ba6c6b52876a097fd8e34e8be08b1958e9: Status 404 returned error can't find the container with id 54de4eaef4796952de78a8cf1b8782ba6c6b52876a097fd8e34e8be08b1958e9
Jul 07 17:48:38.625176 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.625151    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:48:38.779223 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.779183    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" event={"ID":"50b56b5b-2006-4ac1-84ce-95b5b6636c43","Type":"ContainerStarted","Data":"54de4eaef4796952de78a8cf1b8782ba6c6b52876a097fd8e34e8be08b1958e9"}
Jul 07 17:48:38.780360 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:38.780324    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" event={"ID":"d31226a6-4676-45a5-b0e4-23260d0dd0ee","Type":"ContainerStarted","Data":"fe7232d7b47c460988409ce14fa9b12f2def0f8ae5bdbf9395b3cd0f5f0b3cdc"}
Jul 07 17:48:40.635662 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.635574    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:40.800077 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.800041    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" event={"ID":"50b56b5b-2006-4ac1-84ce-95b5b6636c43","Type":"ContainerStarted","Data":"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"}
Jul 07 17:48:40.800266 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.800131    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:40.801710 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.801679    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" event={"ID":"d31226a6-4676-45a5-b0e4-23260d0dd0ee","Type":"ContainerStarted","Data":"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"}
Jul 07 17:48:40.801856 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.801742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:40.826170 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.826138    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:40.878055 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.877994    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" podStartSLOduration=1.8285747940000001 podStartE2EDuration="3.877976925s" totalImagesPullingTime="2.049402131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:40.875204402 +0000 UTC m=+475.068697377" watchObservedRunningTime="2026-07-07 17:48:40.877976925 +0000 UTC m=+475.071469902"
Jul 07 17:48:40.878269 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:40.878248    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" podStartSLOduration=1.116439461 podStartE2EDuration="2.878239657s" totalImagesPullingTime="1.761800196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:48:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:40.845141432 +0000 UTC m=+475.038634432" watchObservedRunningTime="2026-07-07 17:48:40.878239657 +0000 UTC m=+475.071732694"
Jul 07 17:48:51.817286 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:51.817252    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:51.817705 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:51.817324    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:48:51.942887 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:51.942850    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:51.943085 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:51.943060    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" podUID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" containerName="manager" containerID="cri-o://5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e" gracePeriod=30
Jul 07 17:48:52.189923 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.189898    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:52.377901 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.377813    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert\") pod \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") "
Jul 07 17:48:52.378059 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.377925    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klzpk\" (UniqueName: \"kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk\") pod \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\" (UID: \"d31226a6-4676-45a5-b0e4-23260d0dd0ee\") "
Jul 07 17:48:52.380210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.380172    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk" (OuterVolumeSpecName: "kube-api-access-klzpk") pod "d31226a6-4676-45a5-b0e4-23260d0dd0ee" (UID: "d31226a6-4676-45a5-b0e4-23260d0dd0ee"). InnerVolumeSpecName "kube-api-access-klzpk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:52.380319 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.380224    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "d31226a6-4676-45a5-b0e4-23260d0dd0ee" (UID: "d31226a6-4676-45a5-b0e4-23260d0dd0ee"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:48:52.479258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.479223    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/d31226a6-4676-45a5-b0e4-23260d0dd0ee-webhook-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:48:52.479258 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.479254    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klzpk\" (UniqueName: \"kubernetes.io/projected/d31226a6-4676-45a5-b0e4-23260d0dd0ee-kube-api-access-klzpk\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:48:52.864692 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.864649    2567 generic.go:356] "Generic (PLEG): container finished" podID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" containerID="5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e" exitCode=0
Jul 07 17:48:52.865120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.864703    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-67d99b66d4-jwmmm"
Jul 07 17:48:52.865120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.864740    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" event={"ID":"d31226a6-4676-45a5-b0e4-23260d0dd0ee","Type":"ContainerDied","Data":"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"}
Jul 07 17:48:52.865120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.864806    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-67d99b66d4-jwmmm" event={"ID":"d31226a6-4676-45a5-b0e4-23260d0dd0ee","Type":"ContainerDied","Data":"fe7232d7b47c460988409ce14fa9b12f2def0f8ae5bdbf9395b3cd0f5f0b3cdc"}
Jul 07 17:48:52.865120 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.864827    2567 scope.go:117] "RemoveContainer" containerID="5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"
Jul 07 17:48:52.873351 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.873330    2567 scope.go:117] "RemoveContainer" containerID="5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"
Jul 07 17:48:52.873597 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:48:52.873579    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e\": container with ID starting with 5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e not found: ID does not exist" containerID="5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"
Jul 07 17:48:52.873660 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.873603    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e"} err="failed to get container status \"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e\": rpc error: code = NotFound desc = could not find container \"5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e\": container with ID starting with 5ca3df67e4c49ab2711e9c3d107f33d6e4b71a24bb4ba2c2d4beba06f984910e not found: ID does not exist"
Jul 07 17:48:52.887285 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.887258    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:52.889275 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:52.889257    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-67d99b66d4-jwmmm"]
Jul 07 17:48:54.387414 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:48:54.387379    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" path="/var/lib/kubelet/pods/d31226a6-4676-45a5-b0e4-23260d0dd0ee/volumes"
Jul 07 17:49:14.368004 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:14.367966    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:14.870366 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:14.870328    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:15.009229 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.009193    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"]
Jul 07 17:49:15.009585 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.009571    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" containerName="manager"
Jul 07 17:49:15.009628 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.009587    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" containerName="manager"
Jul 07 17:49:15.009663 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.009643    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="d31226a6-4676-45a5-b0e4-23260d0dd0ee" containerName="manager"
Jul 07 17:49:15.012681 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.012658    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.016186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.016164    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 07 17:49:15.016520 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.016495    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-mg6kl\""
Jul 07 17:49:15.037230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.037194    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"]
Jul 07 17:49:15.059054 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.059022    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fda9aec-9f3b-4492-8c3b-66e26f209f93-openshift-service-ca\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.059224 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.059068    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjswm\" (UniqueName: \"kubernetes.io/projected/4fda9aec-9f3b-4492-8c3b-66e26f209f93-kube-api-access-bjswm\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.059224 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.059155    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.159889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.159784    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.159889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.159851    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fda9aec-9f3b-4492-8c3b-66e26f209f93-openshift-service-ca\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.159889 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.159891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjswm\" (UniqueName: \"kubernetes.io/projected/4fda9aec-9f3b-4492-8c3b-66e26f209f93-kube-api-access-bjswm\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.160180 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:49:15.159943    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 17:49:15.160180 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:49:15.160044    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls podName:4fda9aec-9f3b-4492-8c3b-66e26f209f93 nodeName:}" failed. No retries permitted until 2026-07-07 17:49:15.660021541 +0000 UTC m=+509.853514495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls") pod "maas-api-5f5d9f55db-gpdrg" (UID: "4fda9aec-9f3b-4492-8c3b-66e26f209f93") : secret "maas-api-serving-cert" not found
Jul 07 17:49:15.160524 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.160504    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4fda9aec-9f3b-4492-8c3b-66e26f209f93-openshift-service-ca\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.186249 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.186219    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjswm\" (UniqueName: \"kubernetes.io/projected/4fda9aec-9f3b-4492-8c3b-66e26f209f93-kube-api-access-bjswm\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.341230 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.341195    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:15.664107 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.664077    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.666731 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.666701    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4fda9aec-9f3b-4492-8c3b-66e26f209f93-maas-api-tls\") pod \"maas-api-5f5d9f55db-gpdrg\" (UID: \"4fda9aec-9f3b-4492-8c3b-66e26f209f93\") " pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.731083 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.731048    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:15.873606 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.873565    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:15.925286 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.925252    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:15.951824 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.951796    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bx5sv"]
Jul 07 17:49:15.955046 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.955024    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:15.961667 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.961643    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 17:49:15.969469 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.969446    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-77z76\""
Jul 07 17:49:15.987109 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:15.987049    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bx5sv"]
Jul 07 17:49:16.063001 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.062973    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mbmzm"]
Jul 07 17:49:16.065396 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.065381    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.067156 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.067133    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.067210 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.067171    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdwqv\" (UniqueName: \"kubernetes.io/projected/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-kube-api-access-cdwqv\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.086445 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.086419    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"]
Jul 07 17:49:16.089843 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:49:16.089808    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fda9aec_9f3b_4492_8c3b_66e26f209f93.slice/crio-5f9bd44321de22a69639318c828870b9f31667d9619fead05d85e60616d21db1 WatchSource:0}: Error finding container 5f9bd44321de22a69639318c828870b9f31667d9619fead05d85e60616d21db1: Status 404 returned error can't find the container with id 5f9bd44321de22a69639318c828870b9f31667d9619fead05d85e60616d21db1
Jul 07 17:49:16.100087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.100055    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mbmzm"]
Jul 07 17:49:16.168609 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.168567    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xbbf\" (UniqueName: \"kubernetes.io/projected/0ce33647-f4df-4c86-8c81-b110c3662d2e-kube-api-access-4xbbf\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.168825 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.168695    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.168825 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.168727    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdwqv\" (UniqueName: \"kubernetes.io/projected/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-kube-api-access-cdwqv\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.168825 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.168759    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce33647-f4df-4c86-8c81-b110c3662d2e-plugins-config-volume\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.169415 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.169395    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-plugins-config-volume\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.188489 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.188409    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdwqv\" (UniqueName: \"kubernetes.io/projected/3a63bc7a-a09f-4c18-bcb6-6d675891f9e3-kube-api-access-cdwqv\") pod \"payload-pre-processing-7964457696-bx5sv\" (UID: \"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3\") " pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.266377 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.266337    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:16.269168 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.269146    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce33647-f4df-4c86-8c81-b110c3662d2e-plugins-config-volume\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.269218 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.269190    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xbbf\" (UniqueName: \"kubernetes.io/projected/0ce33647-f4df-4c86-8c81-b110c3662d2e-kube-api-access-4xbbf\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.269844 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.269827    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0ce33647-f4df-4c86-8c81-b110c3662d2e-plugins-config-volume\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.303942 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.303907    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xbbf\" (UniqueName: \"kubernetes.io/projected/0ce33647-f4df-4c86-8c81-b110c3662d2e-kube-api-access-4xbbf\") pod \"payload-processing-58f86c7798-mbmzm\" (UID: \"0ce33647-f4df-4c86-8c81-b110c3662d2e\") " pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.375265 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.375223    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:16.417892 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.417863    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-bx5sv"]
Jul 07 17:49:16.443639 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:49:16.443593    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a63bc7a_a09f_4c18_bcb6_6d675891f9e3.slice/crio-053ba192fe7189ed6bc0c4f05ef4b657d98deb07ae9b92c656067c0650be1581 WatchSource:0}: Error finding container 053ba192fe7189ed6bc0c4f05ef4b657d98deb07ae9b92c656067c0650be1581: Status 404 returned error can't find the container with id 053ba192fe7189ed6bc0c4f05ef4b657d98deb07ae9b92c656067c0650be1581
Jul 07 17:49:16.555923 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.553372    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-mbmzm"]
Jul 07 17:49:16.986683 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.986639    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg" event={"ID":"4fda9aec-9f3b-4492-8c3b-66e26f209f93","Type":"ContainerStarted","Data":"5f9bd44321de22a69639318c828870b9f31667d9619fead05d85e60616d21db1"}
Jul 07 17:49:16.987822 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.987797    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm" event={"ID":"0ce33647-f4df-4c86-8c81-b110c3662d2e","Type":"ContainerStarted","Data":"a559833c2c36d583a627c2d77facec943cb9e4703253a6fdcf36b9f8a919da1b"}
Jul 07 17:49:16.989057 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:16.989031    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv" event={"ID":"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3","Type":"ContainerStarted","Data":"053ba192fe7189ed6bc0c4f05ef4b657d98deb07ae9b92c656067c0650be1581"}
Jul 07 17:49:19.003316 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.003277    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg" event={"ID":"4fda9aec-9f3b-4492-8c3b-66e26f209f93","Type":"ContainerStarted","Data":"22dc6ea1b0ca983ae6d5990b073fb8398f2fb7c8d6a37af78c0d990f3f4f74b0"}
Jul 07 17:49:19.003808 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.003385    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:19.004949 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.004923    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm" event={"ID":"0ce33647-f4df-4c86-8c81-b110c3662d2e","Type":"ContainerStarted","Data":"0da03daedeb58a00f6bfd9a7135cb823da44ef6c34bba08f6ca3c8ead5d856eb"}
Jul 07 17:49:19.005080 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.004986    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:19.006336 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.006315    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv" event={"ID":"3a63bc7a-a09f-4c18-bcb6-6d675891f9e3","Type":"ContainerStarted","Data":"07dd1025af58db66195713f634e89e108f59e99185ceecf854f9db2a8dbe4cfb"}
Jul 07 17:49:19.006444 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.006431    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:19.030996 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.030943    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg" podStartSLOduration=3.023853978 podStartE2EDuration="5.030927979s" totalImagesPullingTime="2.007074001s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:19.028607462 +0000 UTC m=+513.222100437" watchObservedRunningTime="2026-07-07 17:49:19.030927979 +0000 UTC m=+513.224420954"
Jul 07 17:49:19.049732 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.049681    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm" podStartSLOduration=1.509138063 podStartE2EDuration="3.049662157s" totalImagesPullingTime="1.540524094s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:19.048311815 +0000 UTC m=+513.241804791" watchObservedRunningTime="2026-07-07 17:49:19.049662157 +0000 UTC m=+513.243155150"
Jul 07 17:49:19.078653 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:19.078604    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv" podStartSLOduration=2.423631362 podStartE2EDuration="4.078588996s" totalImagesPullingTime="1.654957634s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:19.076391972 +0000 UTC m=+513.269884961" watchObservedRunningTime="2026-07-07 17:49:19.078588996 +0000 UTC m=+513.272081971"
Jul 07 17:49:25.016586 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:25.016554    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5f5d9f55db-gpdrg"
Jul 07 17:49:26.062076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:26.062041    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:26.191320 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:26.191272    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:30.012712 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:30.012683    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-bx5sv"
Jul 07 17:49:30.013161 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:30.012752    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-mbmzm"
Jul 07 17:49:46.388285 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.388249    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"]
Jul 07 17:49:46.391480 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.391457    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.396100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.395909    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-rgwkq\""
Jul 07 17:49:46.396100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.395977    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 17:49:46.396100 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.396008    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 17:49:46.396354 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.396291    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 17:49:46.399914 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.399888    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"]
Jul 07 17:49:46.415116 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.415090    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:49:46.544697 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544593    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.544697 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544642    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.544697 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544687    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgtmz\" (UniqueName: \"kubernetes.io/projected/8af58fbc-1403-4fbf-830e-6fea5258b62f-kube-api-access-wgtmz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.544961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544728    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.544961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544806    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.544961 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.544826    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8af58fbc-1403-4fbf-830e-6fea5258b62f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645708 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645667    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645708 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645710    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645743    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgtmz\" (UniqueName: \"kubernetes.io/projected/8af58fbc-1403-4fbf-830e-6fea5258b62f-kube-api-access-wgtmz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645804    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645831    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.645982 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.645848    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8af58fbc-1403-4fbf-830e-6fea5258b62f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.646231 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.646209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.646281 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.646227    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.646281 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.646266    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.648078 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.648057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8af58fbc-1403-4fbf-830e-6fea5258b62f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.648319 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.648302    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8af58fbc-1403-4fbf-830e-6fea5258b62f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.654975 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.654949    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgtmz\" (UniqueName: \"kubernetes.io/projected/8af58fbc-1403-4fbf-830e-6fea5258b62f-kube-api-access-wgtmz\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5\" (UID: \"8af58fbc-1403-4fbf-830e-6fea5258b62f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.704170 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.704114    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:46.845782 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:46.845742    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"]
Jul 07 17:49:46.847018 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:49:46.846994    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af58fbc_1403_4fbf_830e_6fea5258b62f.slice/crio-0390da797c238a561171644601229847c82e81fc0d9b7d22f088414e7516f012 WatchSource:0}: Error finding container 0390da797c238a561171644601229847c82e81fc0d9b7d22f088414e7516f012: Status 404 returned error can't find the container with id 0390da797c238a561171644601229847c82e81fc0d9b7d22f088414e7516f012
Jul 07 17:49:47.158588 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:47.158492    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5" event={"ID":"8af58fbc-1403-4fbf-830e-6fea5258b62f","Type":"ContainerStarted","Data":"0390da797c238a561171644601229847c82e81fc0d9b7d22f088414e7516f012"}
Jul 07 17:49:48.165421 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:48.165390    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5" event={"ID":"8af58fbc-1403-4fbf-830e-6fea5258b62f","Type":"ContainerStarted","Data":"60a4d43af7b78b695d7639e7879bb965a486855c0f1d0df4f44051371c4b051c"}
Jul 07 17:49:48.187673 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:48.187621    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5" podStartSLOduration=1.198057141 podStartE2EDuration="2.187606705s" totalImagesPullingTime="989.549564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:49:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:49:48.186356466 +0000 UTC m=+542.379849442" watchObservedRunningTime="2026-07-07 17:49:48.187606705 +0000 UTC m=+542.381099680"
Jul 07 17:49:56.705071 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:56.705029    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:56.705462 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:56.705106    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:56.717638 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:56.717613    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:49:57.222364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:49:57.222336    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5"
Jul 07 17:50:01.523322 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:01.523289    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:03.713138 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:03.713106    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:14.523634 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.523598    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"]
Jul 07 17:50:14.526087 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.526070    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.529380 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.529359    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 07 17:50:14.584905 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.584870    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:14.611193 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611162    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.611364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611204    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.611364 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611253    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.611435 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611380    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e735a7d3-7588-46b4-9844-1f440a3d79a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.611435 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611413    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxrwr\" (UniqueName: \"kubernetes.io/projected/e735a7d3-7588-46b4-9844-1f440a3d79a2-kube-api-access-sxrwr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.611504 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.611435    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.619338 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.619309    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"]
Jul 07 17:50:14.712439 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712399    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e735a7d3-7588-46b4-9844-1f440a3d79a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.712640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712443    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxrwr\" (UniqueName: \"kubernetes.io/projected/e735a7d3-7588-46b4-9844-1f440a3d79a2-kube-api-access-sxrwr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.712640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712471    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.712640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712520    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.712640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712545    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.712640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712575    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.713009 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.712984    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.713055 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.713012    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.713109 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.713084    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.715091 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.715068    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e735a7d3-7588-46b4-9844-1f440a3d79a2-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.715217 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.715181    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e735a7d3-7588-46b4-9844-1f440a3d79a2-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.723060 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.723034    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxrwr\" (UniqueName: \"kubernetes.io/projected/e735a7d3-7588-46b4-9844-1f440a3d79a2-kube-api-access-sxrwr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w\" (UID: \"e735a7d3-7588-46b4-9844-1f440a3d79a2\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.836372 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.836288    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:14.974190 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:14.974130    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"]
Jul 07 17:50:14.976490 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:50:14.976461    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode735a7d3_7588_46b4_9844_1f440a3d79a2.slice/crio-da7184fe144c5788617c6928d5ac2add2fbd06d85ddd2c1b2e4568c4dfc48acf WatchSource:0}: Error finding container da7184fe144c5788617c6928d5ac2add2fbd06d85ddd2c1b2e4568c4dfc48acf: Status 404 returned error can't find the container with id da7184fe144c5788617c6928d5ac2add2fbd06d85ddd2c1b2e4568c4dfc48acf
Jul 07 17:50:15.304169 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:15.304135    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w" event={"ID":"e735a7d3-7588-46b4-9844-1f440a3d79a2","Type":"ContainerStarted","Data":"8a9f625507e04250d2952ddac5d85095a781096fc417d383e75e2a64268ce2aa"}
Jul 07 17:50:15.304340 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:15.304186    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w" event={"ID":"e735a7d3-7588-46b4-9844-1f440a3d79a2","Type":"ContainerStarted","Data":"da7184fe144c5788617c6928d5ac2add2fbd06d85ddd2c1b2e4568c4dfc48acf"}
Jul 07 17:50:15.330582 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:15.330524    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w" podStartSLOduration=1.161643197 podStartE2EDuration="1.330507334s" totalImagesPullingTime="168.864137ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:50:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:50:15.329610273 +0000 UTC m=+569.523103250" watchObservedRunningTime="2026-07-07 17:50:15.330507334 +0000 UTC m=+569.524000310"
Jul 07 17:50:24.837385 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:24.837348    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:24.837966 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:24.837416    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:24.850391 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:24.850360    2567 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:25.369931 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:25.369895    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w"
Jul 07 17:50:32.607009 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:32.606972    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:45.829906 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:45.829872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:50:46.273977 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:46.273946    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:50:46.274817 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:50:46.274792    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:51:04.967576 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:51:04.967529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:51:05.068737 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:51:05.068677    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:21.743488 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:21.743448    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:25.050780 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:25.050726    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:46.699532 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:46.699436    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:46.804297 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:46.804246    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:47.906143 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:47.906111    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:48.003076 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:48.003039    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:52:57.367237 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:52:57.367201    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:18.938971 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:18.938927    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:50.134284 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:50.134211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:58.112132 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.112077    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:58.211896 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.211853    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:53:58.212149 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.212121    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" podUID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" containerName="manager" containerID="cri-o://b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4" gracePeriod=30
Jul 07 17:53:58.464069 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.464037    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:53:58.500072 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.500040    2567 generic.go:356] "Generic (PLEG): container finished" podID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" containerID="b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4" exitCode=0
Jul 07 17:53:58.500245 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.500079    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" event={"ID":"50b56b5b-2006-4ac1-84ce-95b5b6636c43","Type":"ContainerDied","Data":"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"}
Jul 07 17:53:58.500245 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.500084    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-5n2kd"
Jul 07 17:53:58.500245 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.500118    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-5n2kd" event={"ID":"50b56b5b-2006-4ac1-84ce-95b5b6636c43","Type":"ContainerDied","Data":"54de4eaef4796952de78a8cf1b8782ba6c6b52876a097fd8e34e8be08b1958e9"}
Jul 07 17:53:58.500245 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.500140    2567 scope.go:117] "RemoveContainer" containerID="b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"
Jul 07 17:53:58.509340 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.509315    2567 scope.go:117] "RemoveContainer" containerID="b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"
Jul 07 17:53:58.509701 ip-10-0-143-89 kubenswrapper[2567]: E0707 17:53:58.509676    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4\": container with ID starting with b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4 not found: ID does not exist" containerID="b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"
Jul 07 17:53:58.509809 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.509710    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4"} err="failed to get container status \"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4\": rpc error: code = NotFound desc = could not find container \"b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4\": container with ID starting with b97433a3dff6555c2f3fb1a833082d12c9f482027df97b316e4abeea5e79a4b4 not found: ID does not exist"
Jul 07 17:53:58.605256 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.605213    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert\") pod \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") "
Jul 07 17:53:58.605460 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.605290    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wqhc8\" (UniqueName: \"kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8\") pod \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\" (UID: \"50b56b5b-2006-4ac1-84ce-95b5b6636c43\") "
Jul 07 17:53:58.607446 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.607419    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "50b56b5b-2006-4ac1-84ce-95b5b6636c43" (UID: "50b56b5b-2006-4ac1-84ce-95b5b6636c43"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:53:58.607553 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.607458    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8" (OuterVolumeSpecName: "kube-api-access-wqhc8") pod "50b56b5b-2006-4ac1-84ce-95b5b6636c43" (UID: "50b56b5b-2006-4ac1-84ce-95b5b6636c43"). InnerVolumeSpecName "kube-api-access-wqhc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:53:58.706401 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.706349    2567 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/50b56b5b-2006-4ac1-84ce-95b5b6636c43-webhook-cert\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:53:58.706401 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.706399    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wqhc8\" (UniqueName: \"kubernetes.io/projected/50b56b5b-2006-4ac1-84ce-95b5b6636c43-kube-api-access-wqhc8\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 17:53:58.825274 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.825241    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:53:58.834603 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:58.831862    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-5n2kd"]
Jul 07 17:53:59.516022 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.515987    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:53:59.628376 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.628342    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b964f5f4-d5t6v"]
Jul 07 17:53:59.628747 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.628733    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" containerName="manager"
Jul 07 17:53:59.628811 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.628748    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" containerName="manager"
Jul 07 17:53:59.628864 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.628854    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" containerName="manager"
Jul 07 17:53:59.631451 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.631434    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.635484 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.635462    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-6w4gr\""
Jul 07 17:53:59.635640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.635464    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:53:59.635640 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.635465    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:53:59.641686 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.641663    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-d5t6v"]
Jul 07 17:53:59.815273 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.815167    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26svs\" (UniqueName: \"kubernetes.io/projected/007bb1ac-4b24-4283-be4e-a17c129b96a8-kube-api-access-26svs\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.815273 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.815214    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/007bb1ac-4b24-4283-be4e-a17c129b96a8-webhook-cert\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.916068 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.916036    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26svs\" (UniqueName: \"kubernetes.io/projected/007bb1ac-4b24-4283-be4e-a17c129b96a8-kube-api-access-26svs\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.916068 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.916073    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/007bb1ac-4b24-4283-be4e-a17c129b96a8-webhook-cert\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.918642 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.918621    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/007bb1ac-4b24-4283-be4e-a17c129b96a8-webhook-cert\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.925186 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.925164    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-26svs\" (UniqueName: \"kubernetes.io/projected/007bb1ac-4b24-4283-be4e-a17c129b96a8-kube-api-access-26svs\") pod \"maas-controller-75b964f5f4-d5t6v\" (UID: \"007bb1ac-4b24-4283-be4e-a17c129b96a8\") " pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:53:59.942620 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:53:59.942586    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:54:00.081540 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:00.081517    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b964f5f4-d5t6v"]
Jul 07 17:54:00.083558 ip-10-0-143-89 kubenswrapper[2567]: W0707 17:54:00.083520    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod007bb1ac_4b24_4283_be4e_a17c129b96a8.slice/crio-3da9fd2e983c9cd3fd8b61bf7a9b8f7017b12a25ecca28cf2659aea6f5c022c8 WatchSource:0}: Error finding container 3da9fd2e983c9cd3fd8b61bf7a9b8f7017b12a25ecca28cf2659aea6f5c022c8: Status 404 returned error can't find the container with id 3da9fd2e983c9cd3fd8b61bf7a9b8f7017b12a25ecca28cf2659aea6f5c022c8
Jul 07 17:54:00.084950 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:00.084932    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:54:00.387907 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:00.387831    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50b56b5b-2006-4ac1-84ce-95b5b6636c43" path="/var/lib/kubelet/pods/50b56b5b-2006-4ac1-84ce-95b5b6636c43/volumes"
Jul 07 17:54:00.512920 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:00.512883    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-d5t6v" event={"ID":"007bb1ac-4b24-4283-be4e-a17c129b96a8","Type":"ContainerStarted","Data":"3da9fd2e983c9cd3fd8b61bf7a9b8f7017b12a25ecca28cf2659aea6f5c022c8"}
Jul 07 17:54:01.519345 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:01.519310    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b964f5f4-d5t6v" event={"ID":"007bb1ac-4b24-4283-be4e-a17c129b96a8","Type":"ContainerStarted","Data":"483abb1dd8a9893ec127aa139b3584b0fcdc3e1f46e9622affa7b343525efeb4"}
Jul 07 17:54:01.519734 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:01.519411    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:54:01.541495 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:01.541441    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b964f5f4-d5t6v" podStartSLOduration=2.048955953 podStartE2EDuration="2.541420953s" totalImagesPullingTime="492.465ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:54:01.540389598 +0000 UTC m=+795.733882576" watchObservedRunningTime="2026-07-07 17:54:01.541420953 +0000 UTC m=+795.734913929"
Jul 07 17:54:03.861930 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:03.861900    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:12.530254 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:12.530175    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b964f5f4-d5t6v"
Jul 07 17:54:39.159015 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:39.158975    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:39.258401 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:39.258349    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:39.379257 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:39.379221    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:46.059339 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:46.059298    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:46.172522 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:46.172481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:46.278966 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:46.278930    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:46.436234 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:46.436193    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:52.980292 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:52.980259    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:54:53.098029 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:54:53.097994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:55:46.310129 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:55:46.310045    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:55:46.310627 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:55:46.310427    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 17:57:32.143736 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:57:32.143645    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:58:01.285501 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:58:01.285459    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:58:01.368170 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:58:01.368141    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 17:59:07.895483 ip-10-0-143-89 kubenswrapper[2567]: I0707 17:59:07.895447    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:00:38.525032 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:00:38.524952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:00:46.344011 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:00:46.343967    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:00:46.345300 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:00:46.345276    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:05:34.934474 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:34.934434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:43.201349 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:43.201308    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:43.302750 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:43.302714    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:46.378241 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:46.378207    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:05:46.382235 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:46.382205    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:05:50.754170 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:50.754135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:55.838344 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:55.838309    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:58.700983 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:58.700947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:58.810989 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:58.810960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:05:59.149051 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:05:59.148958    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:05.942069 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:05.942031    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:06.048690 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:06.048604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:06.210848 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:06.210710    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:06.448564 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:06.448513    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:07.384219 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.384178    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:07.471435 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.471402    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:07.474857 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.474836    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.478088 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.478067    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1acf7f3b-serving-cert\""
Jul 07 18:06:07.479897 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.479875    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:07.480135 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.480117    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.480226 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.480212    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-znqcn\" (UniqueName: \"kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.480278 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.480240    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.488084 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.488063    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:07.559453 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.559423    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:07.580702 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.580666    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.580890 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.580754    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-znqcn\" (UniqueName: \"kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.580890 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.580798    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.581057 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:07.580948    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-serving-cert: secret "maas-api-e2e-ait-1acf7f3b-serving-cert" not found
Jul 07 18:06:07.581057 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:07.581017    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls podName:c5c7f655-a121-41db-bbe1-573cf5bb0d19 nodeName:}" failed. No retries permitted until 2026-07-07 18:06:08.080996652 +0000 UTC m=+1522.274489624 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls") pod "maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" (UID: "c5c7f655-a121-41db-bbe1-573cf5bb0d19") : secret "maas-api-e2e-ait-1acf7f3b-serving-cert" not found
Jul 07 18:06:07.581375 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.581354    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.592905 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.592882    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-znqcn\" (UniqueName: \"kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:07.716169 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:07.716135    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:08.083638 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.083559    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:08.086087 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.086057    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") pod \"maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:08.088960 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.088939    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:08.174262 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.174168    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:08.236926 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.236895    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:08.238946 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:06:08.238921    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5c7f655_a121_41db_bbe1_573cf5bb0d19.slice/crio-a4e162d398e6183050cf4b1eecfdd40c9d8d305b42e9d54e09fd85e3acd7303c WatchSource:0}: Error finding container a4e162d398e6183050cf4b1eecfdd40c9d8d305b42e9d54e09fd85e3acd7303c: Status 404 returned error can't find the container with id a4e162d398e6183050cf4b1eecfdd40c9d8d305b42e9d54e09fd85e3acd7303c
Jul 07 18:06:08.240726 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.240708    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:06:08.273727 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.273698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:08.355350 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:08.355274    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" event={"ID":"c5c7f655-a121-41db-bbe1-573cf5bb0d19","Type":"ContainerStarted","Data":"a4e162d398e6183050cf4b1eecfdd40c9d8d305b42e9d54e09fd85e3acd7303c"}
Jul 07 18:06:09.361676 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:09.361638    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" event={"ID":"c5c7f655-a121-41db-bbe1-573cf5bb0d19","Type":"ContainerStarted","Data":"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"}
Jul 07 18:06:09.362091 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:09.361726    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:09.381884 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:09.381832    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" podStartSLOduration=1.7681183169999999 podStartE2EDuration="2.381811685s" totalImagesPullingTime="613.693368ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:09.380889209 +0000 UTC m=+1523.574382185" watchObservedRunningTime="2026-07-07 18:06:09.381811685 +0000 UTC m=+1523.575304662"
Jul 07 18:06:10.368238 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:10.368206    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:12.536103 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.536069    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:12.685918 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.685883    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:12.788844 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.788748    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:12.928273 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.928242    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:12.928453 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.928435    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" podUID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" containerName="maas-api" containerID="cri-o://7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9" gracePeriod=30
Jul 07 18:06:12.955273 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:12.955238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:13.172463 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.172437    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:13.227896 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.227863    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") pod \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") "
Jul 07 18:06:13.228049 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.227914    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca\") pod \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") "
Jul 07 18:06:13.228049 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.227975    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-znqcn\" (UniqueName: \"kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn\") pod \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\" (UID: \"c5c7f655-a121-41db-bbe1-573cf5bb0d19\") "
Jul 07 18:06:13.228327 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.228295    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c5c7f655-a121-41db-bbe1-573cf5bb0d19" (UID: "c5c7f655-a121-41db-bbe1-573cf5bb0d19"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:13.230260 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.230229    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c5c7f655-a121-41db-bbe1-573cf5bb0d19" (UID: "c5c7f655-a121-41db-bbe1-573cf5bb0d19"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:06:13.230341 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.230269    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn" (OuterVolumeSpecName: "kube-api-access-znqcn") pod "c5c7f655-a121-41db-bbe1-573cf5bb0d19" (UID: "c5c7f655-a121-41db-bbe1-573cf5bb0d19"). InnerVolumeSpecName "kube-api-access-znqcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:13.328967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.328890    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-znqcn\" (UniqueName: \"kubernetes.io/projected/c5c7f655-a121-41db-bbe1-573cf5bb0d19-kube-api-access-znqcn\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:13.328967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.328919    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c5c7f655-a121-41db-bbe1-573cf5bb0d19-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:13.328967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.328929    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c5c7f655-a121-41db-bbe1-573cf5bb0d19-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:13.383579 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.383543    2567 generic.go:356] "Generic (PLEG): container finished" podID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" containerID="7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9" exitCode=0
Jul 07 18:06:13.383735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.383590    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"
Jul 07 18:06:13.383735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.383636    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" event={"ID":"c5c7f655-a121-41db-bbe1-573cf5bb0d19","Type":"ContainerDied","Data":"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"}
Jul 07 18:06:13.383735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.383688    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8" event={"ID":"c5c7f655-a121-41db-bbe1-573cf5bb0d19","Type":"ContainerDied","Data":"a4e162d398e6183050cf4b1eecfdd40c9d8d305b42e9d54e09fd85e3acd7303c"}
Jul 07 18:06:13.383735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.383716    2567 scope.go:117] "RemoveContainer" containerID="7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"
Jul 07 18:06:13.394451 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.394426    2567 scope.go:117] "RemoveContainer" containerID="7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"
Jul 07 18:06:13.394747 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:13.394722    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9\": container with ID starting with 7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9 not found: ID does not exist" containerID="7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"
Jul 07 18:06:13.394888 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.394758    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9"} err="failed to get container status \"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9\": rpc error: code = NotFound desc = could not find container \"7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9\": container with ID starting with 7e229cc797f98e99502a04da0cdb37c738cb76d7fbe8445f82deee081a4d17e9 not found: ID does not exist"
Jul 07 18:06:13.407725 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.407693    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:13.412420 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:13.412397    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1acf7f3b-94b7f7b6-j6xn8"]
Jul 07 18:06:14.387611 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:14.387576    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" path="/var/lib/kubelet/pods/c5c7f655-a121-41db-bbe1-573cf5bb0d19/volumes"
Jul 07 18:06:14.964996 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:14.964957    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:18.873322 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:18.873286    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:18.968531 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:18.968493    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:19.149490 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:19.149413    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:19.313852 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:19.313814    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:20.346163 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.346126    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:20.426371 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.426330    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:20.426710 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.426695    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" containerName="maas-api"
Jul 07 18:06:20.426710 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.426709    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" containerName="maas-api"
Jul 07 18:06:20.426897 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.426797    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5c7f655-a121-41db-bbe1-573cf5bb0d19" containerName="maas-api"
Jul 07 18:06:20.429945 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.429923    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.432694 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.432672    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-1f1d4907-serving-cert\""
Jul 07 18:06:20.441967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.441945    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:20.446988 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.446960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:20.495387 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.495355    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.495583 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.495427    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k96jl\" (UniqueName: \"kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.495583 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.495456    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.543014 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.542974    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:20.596509 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.596416    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k96jl\" (UniqueName: \"kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.596509 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.596459    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.596509 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.596501    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.596758 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:20.596640    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-serving-cert: secret "maas-api-e2e-ait-1f1d4907-serving-cert" not found
Jul 07 18:06:20.596758 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:20.596738    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls podName:b13f13b3-7099-47ac-9ffd-b91e540f61ca nodeName:}" failed. No retries permitted until 2026-07-07 18:06:21.09671628 +0000 UTC m=+1535.290209238 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls") pod "maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" (UID: "b13f13b3-7099-47ac-9ffd-b91e540f61ca") : secret "maas-api-e2e-ait-1f1d4907-serving-cert" not found
Jul 07 18:06:20.597231 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.597214    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.607348 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.607323    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k96jl\" (UniqueName: \"kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:20.742394 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:20.742357    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:21.100318 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.100283    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:21.102940 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.102909    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") pod \"maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:21.302563 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.302531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:21.342574 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.342536    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:21.544033 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:06:21.544004    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb13f13b3_7099_47ac_9ffd_b91e540f61ca.slice/crio-ee150085e5b3bf454b9aa7565043db687ccffb53c7f30881da600b1e5b5aac7d WatchSource:0}: Error finding container ee150085e5b3bf454b9aa7565043db687ccffb53c7f30881da600b1e5b5aac7d: Status 404 returned error can't find the container with id ee150085e5b3bf454b9aa7565043db687ccffb53c7f30881da600b1e5b5aac7d
Jul 07 18:06:21.544345 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.544297    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:21.545661 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:21.545639    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:22.142335 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:22.142257    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:22.434986 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:22.434953    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" event={"ID":"b13f13b3-7099-47ac-9ffd-b91e540f61ca","Type":"ContainerStarted","Data":"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"}
Jul 07 18:06:22.435201 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:22.435010    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" event={"ID":"b13f13b3-7099-47ac-9ffd-b91e540f61ca","Type":"ContainerStarted","Data":"ee150085e5b3bf454b9aa7565043db687ccffb53c7f30881da600b1e5b5aac7d"}
Jul 07 18:06:22.435201 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:22.435092    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:22.469034 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:22.468978    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" podStartSLOduration=1.843949838 podStartE2EDuration="2.468962294s" totalImagesPullingTime="625.012456ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:22.468603945 +0000 UTC m=+1536.662096920" watchObservedRunningTime="2026-07-07 18:06:22.468962294 +0000 UTC m=+1536.662455270"
Jul 07 18:06:25.428103 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:25.428064    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:25.819692 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:25.819609    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:25.819896 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:25.819871    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" podUID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" containerName="maas-api" containerID="cri-o://da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd" gracePeriod=30
Jul 07 18:06:25.879919 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:25.879893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:26.071970 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.071910    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:26.144838 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.144798    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k96jl\" (UniqueName: \"kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl\") pod \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") "
Jul 07 18:06:26.145010 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.144895    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca\") pod \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") "
Jul 07 18:06:26.145010 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.145000    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") pod \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\" (UID: \"b13f13b3-7099-47ac-9ffd-b91e540f61ca\") "
Jul 07 18:06:26.145269 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.145239    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b13f13b3-7099-47ac-9ffd-b91e540f61ca" (UID: "b13f13b3-7099-47ac-9ffd-b91e540f61ca"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:26.147180 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.147142    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b13f13b3-7099-47ac-9ffd-b91e540f61ca" (UID: "b13f13b3-7099-47ac-9ffd-b91e540f61ca"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:06:26.147396 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.147379    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl" (OuterVolumeSpecName: "kube-api-access-k96jl") pod "b13f13b3-7099-47ac-9ffd-b91e540f61ca" (UID: "b13f13b3-7099-47ac-9ffd-b91e540f61ca"). InnerVolumeSpecName "kube-api-access-k96jl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:26.246199 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.246163    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b13f13b3-7099-47ac-9ffd-b91e540f61ca-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:26.246199 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.246189    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k96jl\" (UniqueName: \"kubernetes.io/projected/b13f13b3-7099-47ac-9ffd-b91e540f61ca-kube-api-access-k96jl\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:26.246199 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.246200    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b13f13b3-7099-47ac-9ffd-b91e540f61ca-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:26.457864 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.457825    2567 generic.go:356] "Generic (PLEG): container finished" podID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" containerID="da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd" exitCode=0
Jul 07 18:06:26.458246 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.457884    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"
Jul 07 18:06:26.458246 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.457897    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" event={"ID":"b13f13b3-7099-47ac-9ffd-b91e540f61ca","Type":"ContainerDied","Data":"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"}
Jul 07 18:06:26.458246 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.457949    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq" event={"ID":"b13f13b3-7099-47ac-9ffd-b91e540f61ca","Type":"ContainerDied","Data":"ee150085e5b3bf454b9aa7565043db687ccffb53c7f30881da600b1e5b5aac7d"}
Jul 07 18:06:26.458246 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.457978    2567 scope.go:117] "RemoveContainer" containerID="da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"
Jul 07 18:06:26.466510 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.466483    2567 scope.go:117] "RemoveContainer" containerID="da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"
Jul 07 18:06:26.466833 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:26.466803    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd\": container with ID starting with da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd not found: ID does not exist" containerID="da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"
Jul 07 18:06:26.466918 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.466834    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd"} err="failed to get container status \"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd\": rpc error: code = NotFound desc = could not find container \"da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd\": container with ID starting with da0e9de6dd006e4871a45494a7c35cbc042c2fee319e2e74c1266436b40748cd not found: ID does not exist"
Jul 07 18:06:26.482135 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.482111    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:26.494566 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:26.494546    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-1f1d4907-68fb6d5ff9-g75xq"]
Jul 07 18:06:28.387318 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:28.387281    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" path="/var/lib/kubelet/pods/b13f13b3-7099-47ac-9ffd-b91e540f61ca/volumes"
Jul 07 18:06:31.574256 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:31.574217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:31.702366 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:31.702330    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:37.964878 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:37.964844    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:38.037431 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:38.037397    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:38.235526 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:38.235429    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.224816 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.224784    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.330182 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.330140    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.478934 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.478842    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.542659 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.542629    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:39.543052 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.543039    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" containerName="maas-api"
Jul 07 18:06:39.543110 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.543054    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" containerName="maas-api"
Jul 07 18:06:39.543147 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.543109    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="b13f13b3-7099-47ac-9ffd-b91e540f61ca" containerName="maas-api"
Jul 07 18:06:39.547576 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.547552    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.550535 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.550515    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-328d291c-serving-cert\""
Jul 07 18:06:39.567623 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.567602    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:39.602284 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.602238    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.669680 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.669649    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.669889 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.669776    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s882s\" (UniqueName: \"kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.669889 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.669799    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.692554 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.692517    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:39.770920 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.770836    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s882s\" (UniqueName: \"kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.770920 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.770869    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.770920 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.770893    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.771200 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:39.771010    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-serving-cert: secret "maas-api-e2e-derive-328d291c-serving-cert" not found
Jul 07 18:06:39.771200 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:06:39.771083    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls podName:88c377e4-2a9d-426f-a683-899f45590d0a nodeName:}" failed. No retries permitted until 2026-07-07 18:06:40.27106238 +0000 UTC m=+1554.464555340 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls") pod "maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" (UID: "88c377e4-2a9d-426f-a683-899f45590d0a") : secret "maas-api-e2e-derive-328d291c-serving-cert" not found
Jul 07 18:06:39.771463 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.771446    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:39.784742 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:39.784708    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s882s\" (UniqueName: \"kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:40.043481 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.043387    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:40.276035 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.275998    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:40.278549 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.278528    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") pod \"maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:40.294398 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.294335    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:40.423857 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.423822    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:40.457857 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.457820    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:40.603906 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:40.603878    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:40.605330 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:06:40.605305    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88c377e4_2a9d_426f_a683_899f45590d0a.slice/crio-a047d9de69b196548b52ad3b13b415e79c3a32092b32aa062aff81508caab966 WatchSource:0}: Error finding container a047d9de69b196548b52ad3b13b415e79c3a32092b32aa062aff81508caab966: Status 404 returned error can't find the container with id a047d9de69b196548b52ad3b13b415e79c3a32092b32aa062aff81508caab966
Jul 07 18:06:41.540121 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:41.540082    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" event={"ID":"88c377e4-2a9d-426f-a683-899f45590d0a","Type":"ContainerStarted","Data":"1124fb37360983c37336a63863ac297ade493b8d5e304a9fd4746ac0c37bafca"}
Jul 07 18:06:41.540527 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:41.540142    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" event={"ID":"88c377e4-2a9d-426f-a683-899f45590d0a","Type":"ContainerStarted","Data":"a047d9de69b196548b52ad3b13b415e79c3a32092b32aa062aff81508caab966"}
Jul 07 18:06:41.540527 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:41.540305    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:41.564777 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:41.564725    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" podStartSLOduration=2.259087393 podStartE2EDuration="2.564708895s" totalImagesPullingTime="305.621502ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:06:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:06:41.563345609 +0000 UTC m=+1555.756838598" watchObservedRunningTime="2026-07-07 18:06:41.564708895 +0000 UTC m=+1555.758201871"
Jul 07 18:06:42.459155 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:42.459094    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:43.815517 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:43.815484    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:44.017081 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.017045    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:44.104439 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.104338    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:44.345702 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.345674    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:44.345980 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.345952    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" podUID="88c377e4-2a9d-426f-a683-899f45590d0a" containerName="maas-api" containerID="cri-o://1124fb37360983c37336a63863ac297ade493b8d5e304a9fd4746ac0c37bafca" gracePeriod=30
Jul 07 18:06:44.386695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.386663    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:44.563528 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.563497    2567 generic.go:356] "Generic (PLEG): container finished" podID="88c377e4-2a9d-426f-a683-899f45590d0a" containerID="1124fb37360983c37336a63863ac297ade493b8d5e304a9fd4746ac0c37bafca" exitCode=0
Jul 07 18:06:44.563712 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.563557    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" event={"ID":"88c377e4-2a9d-426f-a683-899f45590d0a","Type":"ContainerDied","Data":"1124fb37360983c37336a63863ac297ade493b8d5e304a9fd4746ac0c37bafca"}
Jul 07 18:06:44.593711 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.593690    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:44.716395 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.716368    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") pod \"88c377e4-2a9d-426f-a683-899f45590d0a\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") "
Jul 07 18:06:44.716591 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.716403    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s882s\" (UniqueName: \"kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s\") pod \"88c377e4-2a9d-426f-a683-899f45590d0a\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") "
Jul 07 18:06:44.716591 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.716473    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca\") pod \"88c377e4-2a9d-426f-a683-899f45590d0a\" (UID: \"88c377e4-2a9d-426f-a683-899f45590d0a\") "
Jul 07 18:06:44.716928 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.716903    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "88c377e4-2a9d-426f-a683-899f45590d0a" (UID: "88c377e4-2a9d-426f-a683-899f45590d0a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:06:44.718513 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.718485    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "88c377e4-2a9d-426f-a683-899f45590d0a" (UID: "88c377e4-2a9d-426f-a683-899f45590d0a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:06:44.718616 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.718517    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s" (OuterVolumeSpecName: "kube-api-access-s882s") pod "88c377e4-2a9d-426f-a683-899f45590d0a" (UID: "88c377e4-2a9d-426f-a683-899f45590d0a"). InnerVolumeSpecName "kube-api-access-s882s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:06:44.817724 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.817698    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/88c377e4-2a9d-426f-a683-899f45590d0a-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:44.817724 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.817724    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s882s\" (UniqueName: \"kubernetes.io/projected/88c377e4-2a9d-426f-a683-899f45590d0a-kube-api-access-s882s\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:44.818109 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:44.817733    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/88c377e4-2a9d-426f-a683-899f45590d0a-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:06:45.570231 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.570198    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"
Jul 07 18:06:45.570231 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.570224    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9" event={"ID":"88c377e4-2a9d-426f-a683-899f45590d0a","Type":"ContainerDied","Data":"a047d9de69b196548b52ad3b13b415e79c3a32092b32aa062aff81508caab966"}
Jul 07 18:06:45.570550 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.570286    2567 scope.go:117] "RemoveContainer" containerID="1124fb37360983c37336a63863ac297ade493b8d5e304a9fd4746ac0c37bafca"
Jul 07 18:06:45.612971 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.612941    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:45.615014 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.614992    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-328d291c-c5fc6bc8-mdrq9"]
Jul 07 18:06:45.786032 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:45.786004    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:46.392185 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:46.392151    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88c377e4-2a9d-426f-a683-899f45590d0a" path="/var/lib/kubelet/pods/88c377e4-2a9d-426f-a683-899f45590d0a/volumes"
Jul 07 18:06:50.756800 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:50.756743    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:50.878063 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:50.878029    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:51.213396 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:51.213356    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:51.313741 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:51.313713    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:51.410545 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:51.410499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:52.915482 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:52.915443    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:57.290156 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:57.290116    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:59.251802 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:59.251754    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:59.358168 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:59.358137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:59.452419 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:59.452366    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:59.555986 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:59.555893    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:06:59.975798 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:06:59.975724    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:25.949101 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:25.949047    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:26.806043 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:26.805973    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:32.433082 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:32.433050    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:32.532531 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:32.532499    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:32.652351 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:32.652323    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:48.579873 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:48.579782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:55.457810 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:55.457746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:55.564517 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:55.564482    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:07:55.677740 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:07:55.677707    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:06.192292 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:06.192261    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:07.058548 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:07.058514    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:13.234960 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:13.234921    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:13.304947 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:13.304908    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:13.405697 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:13.405662    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:13.500787 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:13.500686    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:13.600836 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:13.600807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:14.404252 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:14.404223    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:14.600111 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:14.600076    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:16.137205 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:16.137177    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:22.579093 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:22.579064    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:22.681131 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:22.681095    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:23.246686 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:23.246653    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:29.709901 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:29.709828    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:29.777880 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:29.777834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:29.954481 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:29.954444    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:30.288039 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:30.288002    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:30.733773 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:30.733728    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:33.576578 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.576522    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:33.720593 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.720555    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:33.721169 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.721152    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88c377e4-2a9d-426f-a683-899f45590d0a" containerName="maas-api"
Jul 07 18:08:33.721230 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.721172    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="88c377e4-2a9d-426f-a683-899f45590d0a" containerName="maas-api"
Jul 07 18:08:33.721267 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.721250    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="88c377e4-2a9d-426f-a683-899f45590d0a" containerName="maas-api"
Jul 07 18:08:33.724487 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.724470    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.728520 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.728498    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-5f0553bb-serving-cert\""
Jul 07 18:08:33.740567 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.740547    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:33.766634 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.766604    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:33.817513 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.817481    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m4tgw\" (UniqueName: \"kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.817797 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.817547    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.817797 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.817622    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.918751 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.918723    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.918941 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.918779    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.918941 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.918846    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m4tgw\" (UniqueName: \"kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.919508 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.919448    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.921311 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.921288    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.942206 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.942177    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m4tgw\" (UniqueName: \"kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw\") pod \"maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:33.949597 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:33.949551    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:34.036253 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:34.036212    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:34.071203 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:34.071169    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:34.184123 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:34.184044    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:34.187536 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:08:34.187510    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6258581_95ca_4b6f_a187_3e4e72cab83c.slice/crio-c1416ac033a8d63635b43b4d72e2eeedbe87319566309fe4bf4e8dae95593b78 WatchSource:0}: Error finding container c1416ac033a8d63635b43b4d72e2eeedbe87319566309fe4bf4e8dae95593b78: Status 404 returned error can't find the container with id c1416ac033a8d63635b43b4d72e2eeedbe87319566309fe4bf4e8dae95593b78
Jul 07 18:08:34.414874 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:34.414832    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:34.514025 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:34.513917    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:35.135500 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:35.135465    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" event={"ID":"a6258581-95ca-4b6f-a187-3e4e72cab83c","Type":"ContainerStarted","Data":"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"}
Jul 07 18:08:35.135921 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:35.135519    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" event={"ID":"a6258581-95ca-4b6f-a187-3e4e72cab83c","Type":"ContainerStarted","Data":"c1416ac033a8d63635b43b4d72e2eeedbe87319566309fe4bf4e8dae95593b78"}
Jul 07 18:08:35.135921 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:35.135543    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:35.162373 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:35.162325    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" podStartSLOduration=1.774312059 podStartE2EDuration="2.162311278s" totalImagesPullingTime="387.999219ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:08:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:08:35.161383036 +0000 UTC m=+1669.354876012" watchObservedRunningTime="2026-07-07 18:08:35.162311278 +0000 UTC m=+1669.355804290"
Jul 07 18:08:38.023889 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:38.023858    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:38.758998 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:38.758960    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:38.879665 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:38.879619    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:39.222475 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:39.222441    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:41.146132 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:41.146100    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:45.776080 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:45.776037    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:45.901787 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:45.901724    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:46.228078 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.228034    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:46.623611 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.623528    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:46.709819 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.709782    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:46.710055 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.710025    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" podUID="a6258581-95ca-4b6f-a187-3e4e72cab83c" containerName="maas-api" containerID="cri-o://a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365" gracePeriod=30
Jul 07 18:08:46.760954 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.760913    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:46.962014 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:46.961983    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:47.035367 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.035336    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m4tgw\" (UniqueName: \"kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw\") pod \"a6258581-95ca-4b6f-a187-3e4e72cab83c\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") "
Jul 07 18:08:47.035517 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.035412    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls\") pod \"a6258581-95ca-4b6f-a187-3e4e72cab83c\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") "
Jul 07 18:08:47.035517 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.035471    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca\") pod \"a6258581-95ca-4b6f-a187-3e4e72cab83c\" (UID: \"a6258581-95ca-4b6f-a187-3e4e72cab83c\") "
Jul 07 18:08:47.035924 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.035896    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a6258581-95ca-4b6f-a187-3e4e72cab83c" (UID: "a6258581-95ca-4b6f-a187-3e4e72cab83c"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:08:47.037746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.037716    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw" (OuterVolumeSpecName: "kube-api-access-m4tgw") pod "a6258581-95ca-4b6f-a187-3e4e72cab83c" (UID: "a6258581-95ca-4b6f-a187-3e4e72cab83c"). InnerVolumeSpecName "kube-api-access-m4tgw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:08:47.037746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.037731    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a6258581-95ca-4b6f-a187-3e4e72cab83c" (UID: "a6258581-95ca-4b6f-a187-3e4e72cab83c"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:08:47.136902 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.136826    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a6258581-95ca-4b6f-a187-3e4e72cab83c-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:08:47.136902 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.136852    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m4tgw\" (UniqueName: \"kubernetes.io/projected/a6258581-95ca-4b6f-a187-3e4e72cab83c-kube-api-access-m4tgw\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:08:47.136902 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.136862    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a6258581-95ca-4b6f-a187-3e4e72cab83c-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:08:47.198585 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.198548    2567 generic.go:356] "Generic (PLEG): container finished" podID="a6258581-95ca-4b6f-a187-3e4e72cab83c" containerID="a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365" exitCode=0
Jul 07 18:08:47.198746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.198591    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"
Jul 07 18:08:47.198746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.198611    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" event={"ID":"a6258581-95ca-4b6f-a187-3e4e72cab83c","Type":"ContainerDied","Data":"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"}
Jul 07 18:08:47.198746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.198663    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd" event={"ID":"a6258581-95ca-4b6f-a187-3e4e72cab83c","Type":"ContainerDied","Data":"c1416ac033a8d63635b43b4d72e2eeedbe87319566309fe4bf4e8dae95593b78"}
Jul 07 18:08:47.198746 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.198692    2567 scope.go:117] "RemoveContainer" containerID="a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"
Jul 07 18:08:47.208293 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.208242    2567 scope.go:117] "RemoveContainer" containerID="a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"
Jul 07 18:08:47.208546 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:08:47.208519    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365\": container with ID starting with a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365 not found: ID does not exist" containerID="a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"
Jul 07 18:08:47.208591 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.208554    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365"} err="failed to get container status \"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365\": rpc error: code = NotFound desc = could not find container \"a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365\": container with ID starting with a96204a7e47282fd40e85e0614d3cb4b7a5c2a51d577f99b1bd4402fd5d28365 not found: ID does not exist"
Jul 07 18:08:47.225513 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.225486    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:47.237585 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:47.237553    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-5f0553bb-764c68c8fb-wjhmd"]
Jul 07 18:08:48.386986 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:48.386958    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6258581-95ca-4b6f-a187-3e4e72cab83c" path="/var/lib/kubelet/pods/a6258581-95ca-4b6f-a187-3e4e72cab83c/volumes"
Jul 07 18:08:53.109893 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.109854    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:53.209776 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.209730    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:53.401598 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.401515    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:53.713144 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.713113    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:53.831459 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.831424    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:08:53.954924 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:08:53.954890    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:00.022790 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:00.022738    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:00.102336 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:00.102305    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:00.204051 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:00.204014    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:00.374821 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:00.374709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:06.890867 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:06.890747    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:07.010394 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:07.010355    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:13.788249 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:13.788210    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:14.101758 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:14.101673    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:14.297503 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:14.297470    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:16.724781 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.724713    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:16.811385 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.811343    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:16.967579 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.967537    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:09:16.968148 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.968130    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6258581-95ca-4b6f-a187-3e4e72cab83c" containerName="maas-api"
Jul 07 18:09:16.968223 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.968150    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6258581-95ca-4b6f-a187-3e4e72cab83c" containerName="maas-api"
Jul 07 18:09:16.968279 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.968228    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6258581-95ca-4b6f-a187-3e4e72cab83c" containerName="maas-api"
Jul 07 18:09:16.971567 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.971544    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:16.974122 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.974102    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-882c1dd4-serving-cert\""
Jul 07 18:09:16.987417 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:16.987385    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:09:17.006940 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.006903    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.007138 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.006988    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cg9r\" (UniqueName: \"kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.007138 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.007088    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.020964 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.020935    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:17.107657 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.107613    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.107901 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.107701    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7cg9r\" (UniqueName: \"kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.107901 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.107756    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.108635 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.108610    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.110662 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.110639    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.140737 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.140696    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cg9r\" (UniqueName: \"kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r\") pod \"maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.154867 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.154834    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:17.282340 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.282254    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:17.433712 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.433683    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:09:17.435593 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:09:17.435563    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ffe7184_b223_42c9_8f7f_99dea48e75c2.slice/crio-e836ecf7913bb2cd40b06b0882a856431633da7795c4626c6cbe887eab1f127b WatchSource:0}: Error finding container e836ecf7913bb2cd40b06b0882a856431633da7795c4626c6cbe887eab1f127b: Status 404 returned error can't find the container with id e836ecf7913bb2cd40b06b0882a856431633da7795c4626c6cbe887eab1f127b
Jul 07 18:09:17.750904 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.750872    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:17.847881 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:17.847852    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:18.368161 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:18.368124    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" event={"ID":"8ffe7184-b223-42c9-8f7f-99dea48e75c2","Type":"ContainerStarted","Data":"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"}
Jul 07 18:09:18.368378 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:18.368203    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" event={"ID":"8ffe7184-b223-42c9-8f7f-99dea48e75c2","Type":"ContainerStarted","Data":"e836ecf7913bb2cd40b06b0882a856431633da7795c4626c6cbe887eab1f127b"}
Jul 07 18:09:18.368378 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:18.368224    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:18.390835 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:18.390749    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" podStartSLOduration=2.024069946 podStartE2EDuration="2.390733039s" totalImagesPullingTime="366.663093ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:09:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:09:18.390063418 +0000 UTC m=+1712.583556395" watchObservedRunningTime="2026-07-07 18:09:18.390733039 +0000 UTC m=+1712.584226014"
Jul 07 18:09:21.168615 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:21.168583    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:21.667423 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:21.667391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:21.771900 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:21.771867    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:24.379228 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:24.379191    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:09:28.969962 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:28.969922    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:29.069712 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:29.069673    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:33.195969 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:33.195930    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:39.013160 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:39.013125    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:09:39.226563 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:09:39.226526    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:03.935282 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:03.935242    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:04.287408 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.287319    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:10:04.287975 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.287918    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerName="maas-api" containerID="cri-o://974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c" gracePeriod=30
Jul 07 18:10:04.323569 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.323533    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:04.374923 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.374882    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.51:8443/health\": dial tcp 10.134.0.51:8443: connect: connection refused"
Jul 07 18:10:04.550444 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.550380    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:10:04.608733 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.608694    2567 generic.go:356] "Generic (PLEG): container finished" podID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerID="974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c" exitCode=0
Jul 07 18:10:04.608943 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.608741    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" event={"ID":"8ffe7184-b223-42c9-8f7f-99dea48e75c2","Type":"ContainerDied","Data":"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"}
Jul 07 18:10:04.608943 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.608745    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"
Jul 07 18:10:04.608943 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.608808    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb" event={"ID":"8ffe7184-b223-42c9-8f7f-99dea48e75c2","Type":"ContainerDied","Data":"e836ecf7913bb2cd40b06b0882a856431633da7795c4626c6cbe887eab1f127b"}
Jul 07 18:10:04.608943 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.608831    2567 scope.go:117] "RemoveContainer" containerID="974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"
Jul 07 18:10:04.617588 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.617566    2567 scope.go:117] "RemoveContainer" containerID="974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"
Jul 07 18:10:04.617907 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:10:04.617882    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c\": container with ID starting with 974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c not found: ID does not exist" containerID="974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"
Jul 07 18:10:04.617970 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.617918    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c"} err="failed to get container status \"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c\": rpc error: code = NotFound desc = could not find container \"974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c\": container with ID starting with 974be05246bcd23dd0c6b1f7021ac0b429a837d4c463f3a3c3ee13b0c10d038c not found: ID does not exist"
Jul 07 18:10:04.626995 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.626972    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls\") pod \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") "
Jul 07 18:10:04.627115 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.627023    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca\") pod \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") "
Jul 07 18:10:04.627115 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.627105    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7cg9r\" (UniqueName: \"kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r\") pod \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\" (UID: \"8ffe7184-b223-42c9-8f7f-99dea48e75c2\") "
Jul 07 18:10:04.627451 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.627420    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8ffe7184-b223-42c9-8f7f-99dea48e75c2" (UID: "8ffe7184-b223-42c9-8f7f-99dea48e75c2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:10:04.629182 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.629150    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8ffe7184-b223-42c9-8f7f-99dea48e75c2" (UID: "8ffe7184-b223-42c9-8f7f-99dea48e75c2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:10:04.629288 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.629238    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r" (OuterVolumeSpecName: "kube-api-access-7cg9r") pod "8ffe7184-b223-42c9-8f7f-99dea48e75c2" (UID: "8ffe7184-b223-42c9-8f7f-99dea48e75c2"). InnerVolumeSpecName "kube-api-access-7cg9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:10:04.728202 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.728166    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7cg9r\" (UniqueName: \"kubernetes.io/projected/8ffe7184-b223-42c9-8f7f-99dea48e75c2-kube-api-access-7cg9r\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:10:04.728202 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.728199    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8ffe7184-b223-42c9-8f7f-99dea48e75c2-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:10:04.728202 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.728211    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8ffe7184-b223-42c9-8f7f-99dea48e75c2-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:10:04.938089 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.938050    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:10:04.943937 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:04.943912    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-882c1dd4-f759fc546-bdhxb"]
Jul 07 18:10:06.388926 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:06.388894    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" path="/var/lib/kubelet/pods/8ffe7184-b223-42c9-8f7f-99dea48e75c2/volumes"
Jul 07 18:10:10.000254 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:10.000213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:15.043706 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:15.043666    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:46.414119 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:46.414080    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:10:46.420845 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:46.420823    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:10:52.151087 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:52.151056    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:53.520587 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:53.520545    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:10:58.262257 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:10:58.262222    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:22.038827 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:22.038792    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:22.126643 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:22.126603    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:22.322794 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:22.322683    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:23.601260 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:23.601211    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:23.701254 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:23.701213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:23.801010 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:23.800973    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:24.488734 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:24.488698    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:24.587952 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:24.587912    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:24.687351 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:24.687322    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:26.056959 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:26.056928    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:32.264058 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:32.264020    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:32.336776 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:32.336726    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:32.924854 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:32.924815    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:39.126986 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:39.126947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:39.233196 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:39.233163    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:39.328532 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:39.328481    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:49.841598 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:49.841558    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:11:50.226379 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:11:50.226341    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:11.152826 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:11.152712    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:17.327416 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:17.327383    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:17.427302 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:17.427267    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:17.716752 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:17.716720    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:18.085730 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:18.085638    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:18.274187 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:18.274152    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:21.524273 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.524230    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:21.604168 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.604137    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:21.609254 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.609225    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:12:21.609707 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.609686    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerName="maas-api"
Jul 07 18:12:21.609830 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.609710    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerName="maas-api"
Jul 07 18:12:21.609894 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.609851    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ffe7184-b223-42c9-8f7f-99dea48e75c2" containerName="maas-api"
Jul 07 18:12:21.612862 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.612841    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.615662 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.615640    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-fffc51-serving-cert\""
Jul 07 18:12:21.624159 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.624137    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:12:21.668779 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.668740    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:21.763845 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.763813    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.763845 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.763850    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.764043 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.763937    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxl9b\" (UniqueName: \"kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.864889 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.864807    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.864889 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.864857    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.865122 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.864963    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxl9b\" (UniqueName: \"kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.865485 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.865464    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.867032 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.867008    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:21.867556 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.867533    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.876806 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.876782    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxl9b\" (UniqueName: \"kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b\") pod \"maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:21.925661 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:21.925625    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:22.070268 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:22.070242    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:12:22.071816 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:12:22.071789    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e7fcaef_5be5_4420_aa22_c2b41c3e2a24.slice/crio-fb258e3b2e36be0e77515bc05b2a701059e98805a87b99d08c8d0fea26cd75bc WatchSource:0}: Error finding container fb258e3b2e36be0e77515bc05b2a701059e98805a87b99d08c8d0fea26cd75bc: Status 404 returned error can't find the container with id fb258e3b2e36be0e77515bc05b2a701059e98805a87b99d08c8d0fea26cd75bc
Jul 07 18:12:22.073118 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:22.073098    2567 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 18:12:22.239248 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:22.239217    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:22.327139 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:22.327098    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" event={"ID":"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24","Type":"ContainerStarted","Data":"fb258e3b2e36be0e77515bc05b2a701059e98805a87b99d08c8d0fea26cd75bc"}
Jul 07 18:12:22.338968 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:22.338936    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:23.334075 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:23.334032    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" event={"ID":"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24","Type":"ContainerStarted","Data":"fbdc104cc39e105c497be28509f314ab0f7b6535f74e2977dc3830bc7dd899de"}
Jul 07 18:12:23.334580 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:23.334163    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:23.354713 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:23.354662    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" podStartSLOduration=1.8219969539999998 podStartE2EDuration="2.354645589s" totalImagesPullingTime="532.648635ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:12:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:12:23.352183051 +0000 UTC m=+1897.545676027" watchObservedRunningTime="2026-07-07 18:12:23.354645589 +0000 UTC m=+1897.548138564"
Jul 07 18:12:26.033473 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:26.033437    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:26.418345 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:26.418315    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:26.712088 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:26.711994    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:27.053863 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:27.053776    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:29.344964 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.344934    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:12:29.569347 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.569278    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:29.643784 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.643691    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:12:29.647324 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.647301    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.649694 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.649658    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-54d21f-serving-cert\""
Jul 07 18:12:29.656388 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.656349    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:12:29.693015 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.692985    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:29.729283 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.729246    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.729283 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.729293    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bft26\" (UniqueName: \"kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.729497 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.729449    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.805321 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.805285    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:29.830780 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.830736    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.830939 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.830821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.830939 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.830841    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bft26\" (UniqueName: \"kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.831528 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.831503    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.833403 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.833387    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.845708 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.845687    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bft26\" (UniqueName: \"kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26\") pod \"maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:29.912695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.912608    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:29.961597 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:29.961562    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:30.111160 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:30.109816    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:12:30.348688 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:30.348652    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:30.371652 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:30.371618    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" event={"ID":"2ef791e4-38c6-4ddb-9b09-567f06651e89","Type":"ContainerStarted","Data":"7d21f1893184834b85d2cccd9889f5aec0352044d3e630e35338dc5253ed4642"}
Jul 07 18:12:30.494849 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:30.494798    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:31.379303 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:31.379263    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" event={"ID":"2ef791e4-38c6-4ddb-9b09-567f06651e89","Type":"ContainerStarted","Data":"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"}
Jul 07 18:12:31.379697 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:31.379390    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:31.401721 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:31.401664    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" podStartSLOduration=1.954955936 podStartE2EDuration="2.401643907s" totalImagesPullingTime="446.687971ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:12:31.39892318 +0000 UTC m=+1905.592416157" watchObservedRunningTime="2026-07-07 18:12:31.401643907 +0000 UTC m=+1905.595136884"
Jul 07 18:12:34.062234 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:34.062198    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:37.390514 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:37.390486    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:12:44.051427 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:44.051393    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:44.295031 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:44.294992    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:44.391748 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:44.391648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:52.313189 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:52.313148    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:12:52.415009 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:12:52.414976    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:10.717343 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:10.717302    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:32.558715 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:32.558667    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:33.518200 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:33.518160    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:33.635039 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:33.634991    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:34.022640 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.022592    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:34.124741 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.124709    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:34.227074 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.227038    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:34.335448 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.335323    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:13:34.335952 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.335915    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerName="maas-api" containerID="cri-o://fbdc104cc39e105c497be28509f314ab0f7b6535f74e2977dc3830bc7dd899de" gracePeriod=30
Jul 07 18:13:34.340119 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.340080    2567 prober.go:120] "Probe failed" probeType="Readiness" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.52:8443/health\": dial tcp 10.134.0.52:8443: connect: connection refused"
Jul 07 18:13:34.380575 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.380531    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:34.734546 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.734516    2567 generic.go:356] "Generic (PLEG): container finished" podID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerID="fbdc104cc39e105c497be28509f314ab0f7b6535f74e2977dc3830bc7dd899de" exitCode=0
Jul 07 18:13:34.734911 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.734592    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" event={"ID":"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24","Type":"ContainerDied","Data":"fbdc104cc39e105c497be28509f314ab0f7b6535f74e2977dc3830bc7dd899de"}
Jul 07 18:13:34.786973 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.786947    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:13:34.905220 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.905129    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls\") pod \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") "
Jul 07 18:13:34.905220 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.905214    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca\") pod \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") "
Jul 07 18:13:34.905434 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.905242    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nxl9b\" (UniqueName: \"kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b\") pod \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\" (UID: \"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24\") "
Jul 07 18:13:34.905621 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.905592    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" (UID: "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:13:34.907541 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.907514    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b" (OuterVolumeSpecName: "kube-api-access-nxl9b") pod "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" (UID: "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24"). InnerVolumeSpecName "kube-api-access-nxl9b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:13:34.907541 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:34.907523    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" (UID: "7e7fcaef-5be5-4420-aa22-c2b41c3e2a24"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:13:35.006189 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.006146    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:13:35.006189 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.006181    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:13:35.006189 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.006190    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nxl9b\" (UniqueName: \"kubernetes.io/projected/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24-kube-api-access-nxl9b\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:13:35.740561 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.740517    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"
Jul 07 18:13:35.741030 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.740566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj" event={"ID":"7e7fcaef-5be5-4420-aa22-c2b41c3e2a24","Type":"ContainerDied","Data":"fb258e3b2e36be0e77515bc05b2a701059e98805a87b99d08c8d0fea26cd75bc"}
Jul 07 18:13:35.741030 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.740629    2567 scope.go:117] "RemoveContainer" containerID="fbdc104cc39e105c497be28509f314ab0f7b6535f74e2977dc3830bc7dd899de"
Jul 07 18:13:35.764287 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.764250    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:13:35.768259 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:35.768236    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-fffc51-78cc4f756c-tm7kj"]
Jul 07 18:13:36.387926 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:36.387888    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" path="/var/lib/kubelet/pods/7e7fcaef-5be5-4420-aa22-c2b41c3e2a24/volumes"
Jul 07 18:13:39.188975 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:39.188940    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:13:47.088658 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:13:47.088624    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:13.506193 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:13.506157    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:18.091212 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:18.091179    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:18.410893 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:18.410800    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:18.984981 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:18.984945    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:19.311978 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.311894    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:19.592974 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.592884    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:19.693893 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.693859    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:19.861717 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.861625    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:14:19.861920 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.861895    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" podUID="2ef791e4-38c6-4ddb-9b09-567f06651e89" containerName="maas-api" containerID="cri-o://030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434" gracePeriod=30
Jul 07 18:14:19.897489 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:19.897462    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:20.129286 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.129260    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:14:20.190472 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.190440    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca\") pod \"2ef791e4-38c6-4ddb-9b09-567f06651e89\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") "
Jul 07 18:14:20.190631 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.190514    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls\") pod \"2ef791e4-38c6-4ddb-9b09-567f06651e89\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") "
Jul 07 18:14:20.190631 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.190566    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bft26\" (UniqueName: \"kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26\") pod \"2ef791e4-38c6-4ddb-9b09-567f06651e89\" (UID: \"2ef791e4-38c6-4ddb-9b09-567f06651e89\") "
Jul 07 18:14:20.190901 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.190875    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ef791e4-38c6-4ddb-9b09-567f06651e89" (UID: "2ef791e4-38c6-4ddb-9b09-567f06651e89"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:14:20.192832 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.192804    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26" (OuterVolumeSpecName: "kube-api-access-bft26") pod "2ef791e4-38c6-4ddb-9b09-567f06651e89" (UID: "2ef791e4-38c6-4ddb-9b09-567f06651e89"). InnerVolumeSpecName "kube-api-access-bft26". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:20.192832 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.192818    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ef791e4-38c6-4ddb-9b09-567f06651e89" (UID: "2ef791e4-38c6-4ddb-9b09-567f06651e89"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:14:20.292036 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.292003    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ef791e4-38c6-4ddb-9b09-567f06651e89-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:20.292036 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.292033    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ef791e4-38c6-4ddb-9b09-567f06651e89-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:20.292036 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.292042    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bft26\" (UniqueName: \"kubernetes.io/projected/2ef791e4-38c6-4ddb-9b09-567f06651e89-kube-api-access-bft26\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:20.979137 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.979098    2567 generic.go:356] "Generic (PLEG): container finished" podID="2ef791e4-38c6-4ddb-9b09-567f06651e89" containerID="030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434" exitCode=0
Jul 07 18:14:20.979609 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.979148    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"
Jul 07 18:14:20.979609 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.979190    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" event={"ID":"2ef791e4-38c6-4ddb-9b09-567f06651e89","Type":"ContainerDied","Data":"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"}
Jul 07 18:14:20.979609 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.979246    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh" event={"ID":"2ef791e4-38c6-4ddb-9b09-567f06651e89","Type":"ContainerDied","Data":"7d21f1893184834b85d2cccd9889f5aec0352044d3e630e35338dc5253ed4642"}
Jul 07 18:14:20.979609 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.979281    2567 scope.go:117] "RemoveContainer" containerID="030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"
Jul 07 18:14:20.988323 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.988301    2567 scope.go:117] "RemoveContainer" containerID="030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"
Jul 07 18:14:20.988598 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:14:20.988577    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434\": container with ID starting with 030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434 not found: ID does not exist" containerID="030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"
Jul 07 18:14:20.988659 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:20.988611    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434"} err="failed to get container status \"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434\": rpc error: code = NotFound desc = could not find container \"030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434\": container with ID starting with 030319c4a382de0cb7c970ed3eb5da0d1e4e3c5cfa17b4a8a9145b043cea8434 not found: ID does not exist"
Jul 07 18:14:21.008007 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:21.007965    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:14:21.011691 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:21.011663    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-54d21f-7f6d96fbd5-d95bh"]
Jul 07 18:14:22.387725 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:22.387678    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ef791e4-38c6-4ddb-9b09-567f06651e89" path="/var/lib/kubelet/pods/2ef791e4-38c6-4ddb-9b09-567f06651e89/volumes"
Jul 07 18:14:22.491912 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:22.491866    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:22.590138 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:22.590099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:25.811607 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:25.811572    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:25.960113 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:25.960078    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:26.118964 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:26.118884    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:26.660917 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:26.660873    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:27.004869 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:27.004836    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:27.130699 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:27.130668    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:30.261680 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.261640    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:30.389300 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389272    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:30.389634 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389623    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerName="maas-api"
Jul 07 18:14:30.389695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389635    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerName="maas-api"
Jul 07 18:14:30.389695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389652    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ef791e4-38c6-4ddb-9b09-567f06651e89" containerName="maas-api"
Jul 07 18:14:30.389695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389656    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ef791e4-38c6-4ddb-9b09-567f06651e89" containerName="maas-api"
Jul 07 18:14:30.389861 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389726    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ef791e4-38c6-4ddb-9b09-567f06651e89" containerName="maas-api"
Jul 07 18:14:30.389861 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.389733    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="7e7fcaef-5be5-4420-aa22-c2b41c3e2a24" containerName="maas-api"
Jul 07 18:14:30.394138 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.394118    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.398249 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.398224    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-b5c161-serving-cert\""
Jul 07 18:14:30.405200 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.405174    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:30.412967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.412936    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:30.487145 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.487109    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.487312 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.487160    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpbdb\" (UniqueName: \"kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.487360 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.487313    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.510699 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.510657    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:30.588991 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.588891    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.588991 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.588941    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpbdb\" (UniqueName: \"kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.589234 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.589038    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.589234 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:14:30.589101    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-serving-cert: secret "maas-api-e2e-api-a-b5c161-serving-cert" not found
Jul 07 18:14:30.589234 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:14:30.589189    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls podName:11c46b22-84b9-4df6-86b5-0b8f6b786931 nodeName:}" failed. No retries permitted until 2026-07-07 18:14:31.089166125 +0000 UTC m=+2025.282659082 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls") pod "maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" (UID: "11c46b22-84b9-4df6-86b5-0b8f6b786931") : secret "maas-api-e2e-api-a-b5c161-serving-cert" not found
Jul 07 18:14:30.589702 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.589684    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.598857 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.598821    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpbdb\" (UniqueName: \"kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:30.742788 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:30.742737    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:31.093866 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.093832    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:31.094056 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.093832    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:31.096377 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.096345    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") pod \"maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:31.191076 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.191037    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:31.308640 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.308599    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:31.465173 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:31.462902    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:31.465867 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:14:31.465829    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c46b22_84b9_4df6_86b5_0b8f6b786931.slice/crio-7b3a02b8e52df1156b7bcffef6d90ee87ba8a33180af7fbb165429c56f39d0de WatchSource:0}: Error finding container 7b3a02b8e52df1156b7bcffef6d90ee87ba8a33180af7fbb165429c56f39d0de: Status 404 returned error can't find the container with id 7b3a02b8e52df1156b7bcffef6d90ee87ba8a33180af7fbb165429c56f39d0de
Jul 07 18:14:32.042968 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:32.042940    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" event={"ID":"11c46b22-84b9-4df6-86b5-0b8f6b786931","Type":"ContainerStarted","Data":"7b3a02b8e52df1156b7bcffef6d90ee87ba8a33180af7fbb165429c56f39d0de"}
Jul 07 18:14:33.049684 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:33.049650    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" event={"ID":"11c46b22-84b9-4df6-86b5-0b8f6b786931","Type":"ContainerStarted","Data":"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"}
Jul 07 18:14:33.050093 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:33.049799    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:33.077073 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:33.077022    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" podStartSLOduration=2.567287459 podStartE2EDuration="3.076983515s" totalImagesPullingTime="509.696056ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:14:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:14:33.073995844 +0000 UTC m=+2027.267488824" watchObservedRunningTime="2026-07-07 18:14:33.076983515 +0000 UTC m=+2027.270476491"
Jul 07 18:14:34.722853 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:34.722817    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:35.179856 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:35.179826    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:35.525074 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:35.524984    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:35.841613 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:35.841529    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:38.301032 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.300993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:38.428140 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.428099    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:14:38.431922 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.431904    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.435856 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.435835    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-239e66-serving-cert\""
Jul 07 18:14:38.455043 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.455014    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:14:38.473083 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.473052    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:38.564824 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.564707    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.564824 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.564749    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.565010 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.564854    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7s65s\" (UniqueName: \"kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.644792 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.644749    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:38.665859 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.665830    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7s65s\" (UniqueName: \"kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.666003 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.665914    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.666003 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.665944    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.666524 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.666503    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.668619 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.668590    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.680214 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.680186    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7s65s\" (UniqueName: \"kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s\") pod \"maas-api-e2e-api-b-239e66-864855b989-jnrgg\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.741943 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.741905    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:38.749171 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.749141    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:38.894551 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:38.894527    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:14:38.896807 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:14:38.896776    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cfa761_1c77_4f1e_8067_86a4f2e3d388.slice/crio-c6771c6cc5105163e5f425c8649a275835417e0b3e21e30e2bc483bd9a3ee5be WatchSource:0}: Error finding container c6771c6cc5105163e5f425c8649a275835417e0b3e21e30e2bc483bd9a3ee5be: Status 404 returned error can't find the container with id c6771c6cc5105163e5f425c8649a275835417e0b3e21e30e2bc483bd9a3ee5be
Jul 07 18:14:39.061508 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:39.061482    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:39.083649 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:39.083566    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" event={"ID":"e1cfa761-1c77-4f1e-8067-86a4f2e3d388","Type":"ContainerStarted","Data":"c6771c6cc5105163e5f425c8649a275835417e0b3e21e30e2bc483bd9a3ee5be"}
Jul 07 18:14:39.130671 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:39.130629    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:39.301616 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:39.301542    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:40.091017 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:40.090980    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" event={"ID":"e1cfa761-1c77-4f1e-8067-86a4f2e3d388","Type":"ContainerStarted","Data":"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"}
Jul 07 18:14:40.091206 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:40.091109    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:40.111227 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:40.111177    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" podStartSLOduration=1.793885226 podStartE2EDuration="2.111161771s" totalImagesPullingTime="317.276545ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:14:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:14:40.110046313 +0000 UTC m=+2034.303539289" watchObservedRunningTime="2026-07-07 18:14:40.111161771 +0000 UTC m=+2034.304654747"
Jul 07 18:14:42.783132 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:42.783096    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:46.101434 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:46.101409    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:51.045414 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.045374    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:51.375994 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.375882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:51.535959 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.535914    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:51.633058 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.632943    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:51.741805 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.741758    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:51.893899 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.893805    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:51.894185 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.894131    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" podUID="11c46b22-84b9-4df6-86b5-0b8f6b786931" containerName="maas-api" containerID="cri-o://88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435" gracePeriod=30
Jul 07 18:14:51.927151 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:14:51.927124    2567 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11c46b22_84b9_4df6_86b5_0b8f6b786931.slice/crio-conmon-88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435.scope\": RecentStats: unable to find data in memory cache]"
Jul 07 18:14:51.933081 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:51.933054    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:52.150583 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.150513    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:52.159121 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.159095    2567 generic.go:356] "Generic (PLEG): container finished" podID="11c46b22-84b9-4df6-86b5-0b8f6b786931" containerID="88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435" exitCode=0
Jul 07 18:14:52.159255 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.159137    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"
Jul 07 18:14:52.159255 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.159182    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" event={"ID":"11c46b22-84b9-4df6-86b5-0b8f6b786931","Type":"ContainerDied","Data":"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"}
Jul 07 18:14:52.159328 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.159266    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb" event={"ID":"11c46b22-84b9-4df6-86b5-0b8f6b786931","Type":"ContainerDied","Data":"7b3a02b8e52df1156b7bcffef6d90ee87ba8a33180af7fbb165429c56f39d0de"}
Jul 07 18:14:52.159328 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.159290    2567 scope.go:117] "RemoveContainer" containerID="88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"
Jul 07 18:14:52.167979 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.167958    2567 scope.go:117] "RemoveContainer" containerID="88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"
Jul 07 18:14:52.168241 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:14:52.168219    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435\": container with ID starting with 88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435 not found: ID does not exist" containerID="88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"
Jul 07 18:14:52.168338 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.168248    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435"} err="failed to get container status \"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435\": rpc error: code = NotFound desc = could not find container \"88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435\": container with ID starting with 88ad179da8d81995cc7327c943ba75a24356a3f6a6ac8b26052d2c52b40be435 not found: ID does not exist"
Jul 07 18:14:52.298506 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.298472    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") pod \"11c46b22-84b9-4df6-86b5-0b8f6b786931\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") "
Jul 07 18:14:52.298708 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.298522    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca\") pod \"11c46b22-84b9-4df6-86b5-0b8f6b786931\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") "
Jul 07 18:14:52.298708 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.298632    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kpbdb\" (UniqueName: \"kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb\") pod \"11c46b22-84b9-4df6-86b5-0b8f6b786931\" (UID: \"11c46b22-84b9-4df6-86b5-0b8f6b786931\") "
Jul 07 18:14:52.299024 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.298994    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "11c46b22-84b9-4df6-86b5-0b8f6b786931" (UID: "11c46b22-84b9-4df6-86b5-0b8f6b786931"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:14:52.300953 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.300929    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb" (OuterVolumeSpecName: "kube-api-access-kpbdb") pod "11c46b22-84b9-4df6-86b5-0b8f6b786931" (UID: "11c46b22-84b9-4df6-86b5-0b8f6b786931"). InnerVolumeSpecName "kube-api-access-kpbdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:52.301073 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.300953    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "11c46b22-84b9-4df6-86b5-0b8f6b786931" (UID: "11c46b22-84b9-4df6-86b5-0b8f6b786931"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:14:52.400019 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.399992    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/11c46b22-84b9-4df6-86b5-0b8f6b786931-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:52.400019 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.400018    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kpbdb\" (UniqueName: \"kubernetes.io/projected/11c46b22-84b9-4df6-86b5-0b8f6b786931-kube-api-access-kpbdb\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:52.400198 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.400036    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/11c46b22-84b9-4df6-86b5-0b8f6b786931-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:52.486272 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.486230    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:52.492069 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:52.492036    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-b5c161-6f999c888c-2qhkb"]
Jul 07 18:14:54.387642 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:54.387605    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11c46b22-84b9-4df6-86b5-0b8f6b786931" path="/var/lib/kubelet/pods/11c46b22-84b9-4df6-86b5-0b8f6b786931/volumes"
Jul 07 18:14:57.535911 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:57.535878    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:57.610794 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:57.610748    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:57.806867 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:57.806781    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:58.251699 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:58.251667    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:58.678201 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:58.678166    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:58.847344 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:58.847306    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:58.944054 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:58.943964    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:59.102940 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.102906    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:14:59.103280 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.103247    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" podUID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" containerName="maas-api" containerID="cri-o://0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a" gracePeriod=30
Jul 07 18:14:59.131948 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.131920    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:14:59.351952 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.351927    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:14:59.364757 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.364727    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca\") pod \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") "
Jul 07 18:14:59.364757 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.364780    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls\") pod \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") "
Jul 07 18:14:59.364989 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.364829    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7s65s\" (UniqueName: \"kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s\") pod \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\" (UID: \"e1cfa761-1c77-4f1e-8067-86a4f2e3d388\") "
Jul 07 18:14:59.365099 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.365077    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e1cfa761-1c77-4f1e-8067-86a4f2e3d388" (UID: "e1cfa761-1c77-4f1e-8067-86a4f2e3d388"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:14:59.366930 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.366905    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e1cfa761-1c77-4f1e-8067-86a4f2e3d388" (UID: "e1cfa761-1c77-4f1e-8067-86a4f2e3d388"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:14:59.367022 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.366983    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s" (OuterVolumeSpecName: "kube-api-access-7s65s") pod "e1cfa761-1c77-4f1e-8067-86a4f2e3d388" (UID: "e1cfa761-1c77-4f1e-8067-86a4f2e3d388"). InnerVolumeSpecName "kube-api-access-7s65s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:14:59.465990 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.465959    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7s65s\" (UniqueName: \"kubernetes.io/projected/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-kube-api-access-7s65s\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:59.465990 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.465986    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:14:59.465990 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:14:59.465996    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e1cfa761-1c77-4f1e-8067-86a4f2e3d388-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:15:00.203586 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.203537    2567 generic.go:356] "Generic (PLEG): container finished" podID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" containerID="0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a" exitCode=0
Jul 07 18:15:00.203586 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.203586    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"
Jul 07 18:15:00.204104 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.203628    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" event={"ID":"e1cfa761-1c77-4f1e-8067-86a4f2e3d388","Type":"ContainerDied","Data":"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"}
Jul 07 18:15:00.204104 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.203682    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg" event={"ID":"e1cfa761-1c77-4f1e-8067-86a4f2e3d388","Type":"ContainerDied","Data":"c6771c6cc5105163e5f425c8649a275835417e0b3e21e30e2bc483bd9a3ee5be"}
Jul 07 18:15:00.204104 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.203707    2567 scope.go:117] "RemoveContainer" containerID="0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"
Jul 07 18:15:00.215246 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.215197    2567 scope.go:117] "RemoveContainer" containerID="0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"
Jul 07 18:15:00.215673 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:15:00.215650    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a\": container with ID starting with 0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a not found: ID does not exist" containerID="0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"
Jul 07 18:15:00.215735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.215685    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a"} err="failed to get container status \"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a\": rpc error: code = NotFound desc = could not find container \"0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a\": container with ID starting with 0405827ac33efa73cefbec7efbfb62c111d5a1f9f927cf9adaea7c8dfa24591a not found: ID does not exist"
Jul 07 18:15:00.230243 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.230212    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:15:00.245276 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.245252    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-239e66-864855b989-jnrgg"]
Jul 07 18:15:00.388136 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:00.388096    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" path="/var/lib/kubelet/pods/e1cfa761-1c77-4f1e-8067-86a4f2e3d388/volumes"
Jul 07 18:15:05.020493 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:05.020457    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:05.117807 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:05.117746    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:05.282022 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:05.281947    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:05.877650 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:05.877622    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:06.219846 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:06.219807    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:06.597695 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:06.597605    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:09.456037 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.455993    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:09.539491 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539454    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:15:09.539868 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539852    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" containerName="maas-api"
Jul 07 18:15:09.539931 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539870    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" containerName="maas-api"
Jul 07 18:15:09.539931 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539882    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11c46b22-84b9-4df6-86b5-0b8f6b786931" containerName="maas-api"
Jul 07 18:15:09.539931 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539887    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="11c46b22-84b9-4df6-86b5-0b8f6b786931" containerName="maas-api"
Jul 07 18:15:09.540027 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539969    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="11c46b22-84b9-4df6-86b5-0b8f6b786931" containerName="maas-api"
Jul 07 18:15:09.540027 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.539977    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1cfa761-1c77-4f1e-8067-86a4f2e3d388" containerName="maas-api"
Jul 07 18:15:09.544380 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.544304    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.544558 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.544440    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:09.547096 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.547078    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-21f62c-serving-cert\""
Jul 07 18:15:09.555729 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.555697    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:15:09.622988 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.622952    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:09.657045 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.657014    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh7t7\" (UniqueName: \"kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.657222 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.657055    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.657222 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.657073    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.758271 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.758178    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh7t7\" (UniqueName: \"kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.758271 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.758221    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.758271 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.758243    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.758510 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:15:09.758364    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-serving-cert: secret "maas-api-e2e-shared-a-21f62c-serving-cert" not found
Jul 07 18:15:09.758510 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:15:09.758444    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls podName:26bf9275-e191-4bea-b434-68894a993593 nodeName:}" failed. No retries permitted until 2026-07-07 18:15:10.258419548 +0000 UTC m=+2064.451912508 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls") pod "maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" (UID: "26bf9275-e191-4bea-b434-68894a993593") : secret "maas-api-e2e-shared-a-21f62c-serving-cert" not found
Jul 07 18:15:09.758939 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.758922    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:09.768980 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:09.768957    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh7t7\" (UniqueName: \"kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:10.184825 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.184790    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:10.263855 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.263821    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:10.266370 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.266346    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") pod \"maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:10.284883 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.284856    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:10.392541 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.392502    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:10.455987 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.455885    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:10.615537 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:10.615510    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:15:10.617531 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:15:10.617495    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26bf9275_e191_4bea_b434_68894a993593.slice/crio-417354831d2c53607855eb1de8151802988c6cdafbf900ad42bf68e78f695df3 WatchSource:0}: Error finding container 417354831d2c53607855eb1de8151802988c6cdafbf900ad42bf68e78f695df3: Status 404 returned error can't find the container with id 417354831d2c53607855eb1de8151802988c6cdafbf900ad42bf68e78f695df3
Jul 07 18:15:11.266697 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:11.266658    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" event={"ID":"26bf9275-e191-4bea-b434-68894a993593","Type":"ContainerStarted","Data":"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"}
Jul 07 18:15:11.266912 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:11.266718    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" event={"ID":"26bf9275-e191-4bea-b434-68894a993593","Type":"ContainerStarted","Data":"417354831d2c53607855eb1de8151802988c6cdafbf900ad42bf68e78f695df3"}
Jul 07 18:15:11.266912 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:11.266759    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:11.297264 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:11.297207    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" podStartSLOduration=1.785723648 podStartE2EDuration="2.297190813s" totalImagesPullingTime="511.467165ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:11.293467869 +0000 UTC m=+2065.486960845" watchObservedRunningTime="2026-07-07 18:15:11.297190813 +0000 UTC m=+2065.490683789"
Jul 07 18:15:13.988968 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:13.988935    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:14.322130 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:14.322035    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:14.716245 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:14.716215    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:15.096102 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:15.096022    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:17.278192 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.278159    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:15:17.585958 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.585847    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:17.753618 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.753583    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:15:17.757410 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.757390    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.759966 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.759947    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-fad388-serving-cert\""
Jul 07 18:15:17.769495 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.769468    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:15:17.834514 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.834478    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.834514 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.834517    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.834735 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.834561    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-86wwr\" (UniqueName: \"kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.885069 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.884980    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:17.935426 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.935384    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-86wwr\" (UniqueName: \"kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.935608 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.935503    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.935608 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.935535    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.935699 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:15:17.935644    2567 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-serving-cert: secret "maas-api-e2e-shared-b-fad388-serving-cert" not found
Jul 07 18:15:17.935741 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:15:17.935725    2567 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls podName:14292774-c365-451b-872e-eff6b0b08ed9 nodeName:}" failed. No retries permitted until 2026-07-07 18:15:18.435689964 +0000 UTC m=+2072.629182925 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls") pod "maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" (UID: "14292774-c365-451b-872e-eff6b0b08ed9") : secret "maas-api-e2e-shared-b-fad388-serving-cert" not found
Jul 07 18:15:17.936175 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.936154    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:17.955953 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:17.955925    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-86wwr\" (UniqueName: \"kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:18.011451 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.011412    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:18.263890 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.263853    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:18.366140 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.366099    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:18.440538 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.440494    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:18.443109 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.443088    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") pod \"maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:18.465925 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.465898    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:18.670740 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.670709    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:18.821145 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:18.821120    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:15:18.822943 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:15:18.822909    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14292774_c365_451b_872e_eff6b0b08ed9.slice/crio-f6fc6288f540c921a2086a4b4ea40d79a576d3859ff0e5d2eb27030871e312b3 WatchSource:0}: Error finding container f6fc6288f540c921a2086a4b4ea40d79a576d3859ff0e5d2eb27030871e312b3: Status 404 returned error can't find the container with id f6fc6288f540c921a2086a4b4ea40d79a576d3859ff0e5d2eb27030871e312b3
Jul 07 18:15:19.312693 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:19.312664    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" event={"ID":"14292774-c365-451b-872e-eff6b0b08ed9","Type":"ContainerStarted","Data":"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"}
Jul 07 18:15:19.312843 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:19.312712    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" event={"ID":"14292774-c365-451b-872e-eff6b0b08ed9","Type":"ContainerStarted","Data":"f6fc6288f540c921a2086a4b4ea40d79a576d3859ff0e5d2eb27030871e312b3"}
Jul 07 18:15:19.312843 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:19.312742    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:22.123421 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:22.123381    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:25.326507 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:25.326475    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:15:25.344967 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:25.344919    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" podStartSLOduration=7.934064466 podStartE2EDuration="8.34490178s" totalImagesPullingTime="410.837314ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 18:15:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:15:19.355354607 +0000 UTC m=+2073.548847583" watchObservedRunningTime="2026-07-07 18:15:25.34490178 +0000 UTC m=+2079.538394756"
Jul 07 18:15:29.172927 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:29.172891    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:31.096611 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:31.096571    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:31.198673 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:31.198622    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:40.310478 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:40.310442    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:40.410632 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:40.410590    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:15:46.449123 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:46.449082    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:15:46.460866 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:46.460839    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:15:55.672574 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:15:55.672525    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:16:09.118911 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:16:09.118870    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:30.306017 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:17:30.305980    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:43.036984 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:17:43.036944    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:44.026022 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:17:44.025983    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:17:49.431578 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:17:49.431540    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:18:23.250123 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:18:23.250088    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:18:55.487125 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:18:55.487084    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:18:56.299310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:18:56.299272    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:19:20.036914 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:19:20.036882    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:19:23.274014 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:19:23.273976    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:19:23.375494 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:19:23.375434    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:19:36.980744 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:19:36.980648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:23.561150 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:23.561112    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:24.630688 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:24.630648    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:25.677831 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:25.677787    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:26.117878 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.117782    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:26.256835 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.256801    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:26.354797 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.354747    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:26.539786 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.539734    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:20:26.540012 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.539964    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" podUID="26bf9275-e191-4bea-b434-68894a993593" containerName="maas-api" containerID="cri-o://bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29" gracePeriod=30
Jul 07 18:20:26.574277 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.574251    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:26.795489 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.795432    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:20:26.874072 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.874043    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") pod \"26bf9275-e191-4bea-b434-68894a993593\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") "
Jul 07 18:20:26.874211 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.874085    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca\") pod \"26bf9275-e191-4bea-b434-68894a993593\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") "
Jul 07 18:20:26.874211 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.874111    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zh7t7\" (UniqueName: \"kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7\") pod \"26bf9275-e191-4bea-b434-68894a993593\" (UID: \"26bf9275-e191-4bea-b434-68894a993593\") "
Jul 07 18:20:26.874467 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.874443    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "26bf9275-e191-4bea-b434-68894a993593" (UID: "26bf9275-e191-4bea-b434-68894a993593"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:20:26.876314 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.876292    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7" (OuterVolumeSpecName: "kube-api-access-zh7t7") pod "26bf9275-e191-4bea-b434-68894a993593" (UID: "26bf9275-e191-4bea-b434-68894a993593"). InnerVolumeSpecName "kube-api-access-zh7t7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:20:26.876398 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.876314    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "26bf9275-e191-4bea-b434-68894a993593" (UID: "26bf9275-e191-4bea-b434-68894a993593"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:20:26.961614 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.961579    2567 generic.go:356] "Generic (PLEG): container finished" podID="26bf9275-e191-4bea-b434-68894a993593" containerID="bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29" exitCode=0
Jul 07 18:20:26.961786 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.961614    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" event={"ID":"26bf9275-e191-4bea-b434-68894a993593","Type":"ContainerDied","Data":"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"}
Jul 07 18:20:26.961786 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.961672    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv" event={"ID":"26bf9275-e191-4bea-b434-68894a993593","Type":"ContainerDied","Data":"417354831d2c53607855eb1de8151802988c6cdafbf900ad42bf68e78f695df3"}
Jul 07 18:20:26.961786 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.961692    2567 scope.go:117] "RemoveContainer" containerID="bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"
Jul 07 18:20:26.961786 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.961626    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"
Jul 07 18:20:26.971544 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.971523    2567 scope.go:117] "RemoveContainer" containerID="bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"
Jul 07 18:20:26.971828 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:20:26.971805    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29\": container with ID starting with bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29 not found: ID does not exist" containerID="bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"
Jul 07 18:20:26.971891 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.971832    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29"} err="failed to get container status \"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29\": rpc error: code = NotFound desc = could not find container \"bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29\": container with ID starting with bbdbd9871932ec7ab2a8045e47c503c67f2ae3366ca45e4018ee7c0fd0988f29 not found: ID does not exist"
Jul 07 18:20:26.974861 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.974845    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/26bf9275-e191-4bea-b434-68894a993593-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:20:26.974923 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.974863    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/26bf9275-e191-4bea-b434-68894a993593-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:20:26.974923 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.974875    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zh7t7\" (UniqueName: \"kubernetes.io/projected/26bf9275-e191-4bea-b434-68894a993593-kube-api-access-zh7t7\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:20:26.985941 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.985918    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:20:26.990398 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:26.990368    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-21f62c-778d4fdb48-vmhmv"]
Jul 07 18:20:28.387739 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:28.387707    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26bf9275-e191-4bea-b434-68894a993593" path="/var/lib/kubelet/pods/26bf9275-e191-4bea-b434-68894a993593/volumes"
Jul 07 18:20:31.157835 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:31.157797    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:41.170995 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:41.170950    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:41.269593 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:41.269559    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:20:46.487434 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:46.487407    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:20:46.500346 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:20:46.500322    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pb6hm_357e8fa9-db38-4687-bc06-4cb59eeb698b/ovn-acl-logging/0.log"
Jul 07 18:21:08.229814 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:08.229734    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:09.376669 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.376637    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:09.408338 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.408302    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:21:09.408601 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.408552    2567 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" podUID="14292774-c365-451b-872e-eff6b0b08ed9" containerName="maas-api" containerID="cri-o://72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd" gracePeriod=30
Jul 07 18:21:09.476424 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.476391    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:09.659831 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.659807    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:21:09.761455 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.761427    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca\") pod \"14292774-c365-451b-872e-eff6b0b08ed9\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") "
Jul 07 18:21:09.761455 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.761462    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") pod \"14292774-c365-451b-872e-eff6b0b08ed9\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") "
Jul 07 18:21:09.761649 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.761543    2567 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-86wwr\" (UniqueName: \"kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr\") pod \"14292774-c365-451b-872e-eff6b0b08ed9\" (UID: \"14292774-c365-451b-872e-eff6b0b08ed9\") "
Jul 07 18:21:09.761883 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.761841    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "14292774-c365-451b-872e-eff6b0b08ed9" (UID: "14292774-c365-451b-872e-eff6b0b08ed9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 18:21:09.763566 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.763546    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "14292774-c365-451b-872e-eff6b0b08ed9" (UID: "14292774-c365-451b-872e-eff6b0b08ed9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 18:21:09.763674 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.763656    2567 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr" (OuterVolumeSpecName: "kube-api-access-86wwr") pod "14292774-c365-451b-872e-eff6b0b08ed9" (UID: "14292774-c365-451b-872e-eff6b0b08ed9"). InnerVolumeSpecName "kube-api-access-86wwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 18:21:09.862279 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.862245    2567 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-86wwr\" (UniqueName: \"kubernetes.io/projected/14292774-c365-451b-872e-eff6b0b08ed9-kube-api-access-86wwr\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:21:09.862279 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.862273    2567 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/14292774-c365-451b-872e-eff6b0b08ed9-openshift-service-ca\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:21:09.862279 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:09.862282    2567 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/14292774-c365-451b-872e-eff6b0b08ed9-maas-api-tls\") on node \"ip-10-0-143-89.ec2.internal\" DevicePath \"\""
Jul 07 18:21:10.188941 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.188902    2567 generic.go:356] "Generic (PLEG): container finished" podID="14292774-c365-451b-872e-eff6b0b08ed9" containerID="72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd" exitCode=0
Jul 07 18:21:10.189105 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.188942    2567 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"
Jul 07 18:21:10.189105 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.188977    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" event={"ID":"14292774-c365-451b-872e-eff6b0b08ed9","Type":"ContainerDied","Data":"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"}
Jul 07 18:21:10.189105 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.189023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth" event={"ID":"14292774-c365-451b-872e-eff6b0b08ed9","Type":"ContainerDied","Data":"f6fc6288f540c921a2086a4b4ea40d79a576d3859ff0e5d2eb27030871e312b3"}
Jul 07 18:21:10.189105 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.189046    2567 scope.go:117] "RemoveContainer" containerID="72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"
Jul 07 18:21:10.198812 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.198787    2567 scope.go:117] "RemoveContainer" containerID="72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"
Jul 07 18:21:10.199132 ip-10-0-143-89 kubenswrapper[2567]: E0707 18:21:10.199105    2567 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd\": container with ID starting with 72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd not found: ID does not exist" containerID="72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"
Jul 07 18:21:10.199218 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.199144    2567 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd"} err="failed to get container status \"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd\": rpc error: code = NotFound desc = could not find container \"72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd\": container with ID starting with 72459332ebccd6d0f9da18a7f3d0ae05d616d210b82bf0dde09f2fa8d2542cdd not found: ID does not exist"
Jul 07 18:21:10.213018 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.212995    2567 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:21:10.218668 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.218646    2567 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-fad388-57d8b79bbc-bgcth"]
Jul 07 18:21:10.387661 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:10.387627    2567 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="14292774-c365-451b-872e-eff6b0b08ed9" path="/var/lib/kubelet/pods/14292774-c365-451b-872e-eff6b0b08ed9/volumes"
Jul 07 18:21:16.023877 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:16.023838    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:16.126151 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:16.126115    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:16.415372 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:16.415340    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:22.099874 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:22.099842    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b964f5f4-d5t6v_007bb1ac-4b24-4283-be4e-a17c129b96a8/manager/0.log"
Jul 07 18:21:22.728381 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:22.728350    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-wp984_5450e2a0-22e5-434f-a380-5dfaa3caacae/copy-manifests/0.log"
Jul 07 18:21:22.746745 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:22.746718    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-wp984_5450e2a0-22e5-434f-a380-5dfaa3caacae/manager/0.log"
Jul 07 18:21:23.550455 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.550423    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/pull/0.log"
Jul 07 18:21:23.558178 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.558153    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/extract/0.log"
Jul 07 18:21:23.565179 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.565158    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/util/0.log"
Jul 07 18:21:23.678130 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.678098    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/util/0.log"
Jul 07 18:21:23.686423 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.686399    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/pull/0.log"
Jul 07 18:21:23.694801 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.694783    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/extract/0.log"
Jul 07 18:21:23.825127 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.825057    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/util/0.log"
Jul 07 18:21:23.831772 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.831740    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/pull/0.log"
Jul 07 18:21:23.838564 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.838539    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/extract/0.log"
Jul 07 18:21:23.953843 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.953814    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/util/0.log"
Jul 07 18:21:23.961123 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.961077    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/pull/0.log"
Jul 07 18:21:23.968506 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:23.968486    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/extract/0.log"
Jul 07 18:21:25.427622 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:25.427596    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8f24_d26f1587-52a4-4fd6-ba8d-4b3aba444dac/discovery/0.log"
Jul 07 18:21:25.933614 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:25.933582    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bx5sv_3a63bc7a-a09f-4c18-bcb6-6d675891f9e3/payload-pre-processing/0.log"
Jul 07 18:21:26.054575 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:26.054548    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mbmzm_0ce33647-f4df-4c86-8c81-b110c3662d2e/payload-processing/0.log"
Jul 07 18:21:26.563631 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:26.563600    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-tnlr5_8af58fbc-1403-4fbf-830e-6fea5258b62f/main/0.log"
Jul 07 18:21:26.955985 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:26.955959    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbd6l7w_e735a7d3-7588-46b4-9844-1f440a3d79a2/main/0.log"
Jul 07 18:21:28.739244 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:28.739213    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:31.405817 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:31.405786    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:31.507293 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:31.507260    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:34.539930 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:34.539894    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bgktw_f2c6dc91-27a0-4b0e-af69-067ab3e0ff7f/global-pull-secret-syncer/0.log"
Jul 07 18:21:34.578633 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:34.578576    2567 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log" limit=1024
Jul 07 18:21:34.603672 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:34.603642    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-6lkzm_44a8d9a9-0955-4c09-af83-0ec35fdc3dbb/konnectivity-agent/0.log"
Jul 07 18:21:34.776126 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:34.776097    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-89.ec2.internal_b8eb586876eff2840404d1d6ada06a7c/haproxy/0.log"
Jul 07 18:21:39.427125 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.427090    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/extract/0.log"
Jul 07 18:21:39.456617 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.456591    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/util/0.log"
Jul 07 18:21:39.482706 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.482680    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rtxz2_b45d7c42-a08b-4653-b454-c6a0872d1d27/pull/0.log"
Jul 07 18:21:39.515196 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.515174    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/extract/0.log"
Jul 07 18:21:39.540253 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.540230    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/util/0.log"
Jul 07 18:21:39.567396 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.567377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0f5j8j_72d1c5d5-17d4-4ae5-b5be-cda29ff77ce0/pull/0.log"
Jul 07 18:21:39.623164 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.623139    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/extract/0.log"
Jul 07 18:21:39.654398 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.654377    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/util/0.log"
Jul 07 18:21:39.687870 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.687813    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73r2552_707b4c7b-5173-4c2a-9efb-a2b6c658de5d/pull/0.log"
Jul 07 18:21:39.721463 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.721444    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/extract/0.log"
Jul 07 18:21:39.757158 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.757132    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/util/0.log"
Jul 07 18:21:39.788242 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:39.788222    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1mb7db_cd8bc6e0-e4bf-4e9a-beb2-42908831da89/pull/0.log"
Jul 07 18:21:42.412400 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.412321    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/alertmanager/0.log"
Jul 07 18:21:42.441269 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.441241    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/config-reloader/0.log"
Jul 07 18:21:42.472658 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.472634    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/kube-rbac-proxy-web/0.log"
Jul 07 18:21:42.500836 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.500817    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/kube-rbac-proxy/0.log"
Jul 07 18:21:42.527558 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.527529    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/kube-rbac-proxy-metric/0.log"
Jul 07 18:21:42.568603 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.568577    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/prom-label-proxy/0.log"
Jul 07 18:21:42.600244 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.600219    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_a2db4b73-a071-4380-854c-3ef3ef0ce2d8/init-config-reloader/0.log"
Jul 07 18:21:42.877004 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.876972    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4dsdd_ba55a659-61d3-418a-9ac2-f302c1d42c93/node-exporter/0.log"
Jul 07 18:21:42.924179 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.924155    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4dsdd_ba55a659-61d3-418a-9ac2-f302c1d42c93/kube-rbac-proxy/0.log"
Jul 07 18:21:42.956927 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:42.956902    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-4dsdd_ba55a659-61d3-418a-9ac2-f302c1d42c93/init-textfile/0.log"
Jul 07 18:21:43.187053 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.187022    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-clr72_f1957152-74a3-41b9-9ea1-fc33ec8d481d/kube-rbac-proxy-main/0.log"
Jul 07 18:21:43.228291 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.228263    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-clr72_f1957152-74a3-41b9-9ea1-fc33ec8d481d/kube-rbac-proxy-self/0.log"
Jul 07 18:21:43.253035 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.253012    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-54cf96dfcf-clr72_f1957152-74a3-41b9-9ea1-fc33ec8d481d/openshift-state-metrics/0.log"
Jul 07 18:21:43.714579 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.714528    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-qdrft_557a6aac-ce7a-4771-b941-dd0386394a9c/prometheus-operator-admission-webhook/0.log"
Jul 07 18:21:43.776095 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.776057    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869cd988bd-fg2pf_612dea83-31d4-432e-a044-f1e13a3b3bd6/telemeter-client/0.log"
Jul 07 18:21:43.816594 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.816559    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869cd988bd-fg2pf_612dea83-31d4-432e-a044-f1e13a3b3bd6/reload/0.log"
Jul 07 18:21:43.855515 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:43.855488    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-869cd988bd-fg2pf_612dea83-31d4-432e-a044-f1e13a3b3bd6/kube-rbac-proxy/0.log"
Jul 07 18:21:44.455824 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.455787    2567 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"]
Jul 07 18:21:44.456168 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456154    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26bf9275-e191-4bea-b434-68894a993593" containerName="maas-api"
Jul 07 18:21:44.456212 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456170    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="26bf9275-e191-4bea-b434-68894a993593" containerName="maas-api"
Jul 07 18:21:44.456212 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456201    2567 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14292774-c365-451b-872e-eff6b0b08ed9" containerName="maas-api"
Jul 07 18:21:44.456212 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456207    2567 state_mem.go:107] "Deleted CPUSet assignment" podUID="14292774-c365-451b-872e-eff6b0b08ed9" containerName="maas-api"
Jul 07 18:21:44.456302 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456265    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="14292774-c365-451b-872e-eff6b0b08ed9" containerName="maas-api"
Jul 07 18:21:44.456302 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.456274    2567 memory_manager.go:368] "RemoveStaleState removing state" podUID="26bf9275-e191-4bea-b434-68894a993593" containerName="maas-api"
Jul 07 18:21:44.459537 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.459521    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.462748 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.462727    2567 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-99zpf\"/\"default-dockercfg-bkmgk\""
Jul 07 18:21:44.463880 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.463863    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99zpf\"/\"openshift-service-ca.crt\""
Jul 07 18:21:44.463981 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.463887    2567 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-99zpf\"/\"kube-root-ca.crt\""
Jul 07 18:21:44.472618 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.472598    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"]
Jul 07 18:21:44.573645 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.573609    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-lib-modules\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.573645 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.573643    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8b2z\" (UniqueName: \"kubernetes.io/projected/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-kube-api-access-v8b2z\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.573899 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.573668    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-podres\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.573899 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.573735    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-sys\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.573899 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.573796    2567 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-proc\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675061 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675027    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-sys\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675061 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675065    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-proc\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675122    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-lib-modules\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675138    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8b2z\" (UniqueName: \"kubernetes.io/projected/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-kube-api-access-v8b2z\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675148    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-sys\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675161    2567 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-podres\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675209    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-proc\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675264    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-podres\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.675310 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.675268    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-lib-modules\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.685839 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.685818    2567 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8b2z\" (UniqueName: \"kubernetes.io/projected/5079cef8-d90a-44ec-8b49-b78aec1e5f4f-kube-api-access-v8b2z\") pod \"perf-node-gather-daemonset-kn8nn\" (UID: \"5079cef8-d90a-44ec-8b49-b78aec1e5f4f\") " pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.770219 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.770132    2567 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:44.915095 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:44.915068    2567 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"]
Jul 07 18:21:44.917037 ip-10-0-143-89 kubenswrapper[2567]: W0707 18:21:44.917001    2567 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5079cef8_d90a_44ec_8b49_b78aec1e5f4f.slice/crio-2f68b7a7631241c5e172d67dafcf3cb7dfe2c4f98d37618e08f2d4c7ab4f03fe WatchSource:0}: Error finding container 2f68b7a7631241c5e172d67dafcf3cb7dfe2c4f98d37618e08f2d4c7ab4f03fe: Status 404 returned error can't find the container with id 2f68b7a7631241c5e172d67dafcf3cb7dfe2c4f98d37618e08f2d4c7ab4f03fe
Jul 07 18:21:45.364705 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:45.364667    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-5mwk2_f49517b2-fa19-431a-a851-7f9978e3508b/networking-console-plugin/0.log"
Jul 07 18:21:45.376051 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:45.376023    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn" event={"ID":"5079cef8-d90a-44ec-8b49-b78aec1e5f4f","Type":"ContainerStarted","Data":"2f8b8b484fda6d2159f50d7d2e2e00a006d69cf7995ddc36b59f3a61decbca92"}
Jul 07 18:21:45.376215 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:45.376067    2567 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn" event={"ID":"5079cef8-d90a-44ec-8b49-b78aec1e5f4f","Type":"ContainerStarted","Data":"2f68b7a7631241c5e172d67dafcf3cb7dfe2c4f98d37618e08f2d4c7ab4f03fe"}
Jul 07 18:21:45.376215 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:45.376203    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:45.395819 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:45.395739    2567 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn" podStartSLOduration=1.395723702 podStartE2EDuration="1.395723702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 18:21:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 18:21:45.394620851 +0000 UTC m=+2459.588113827" watchObservedRunningTime="2026-07-07 18:21:45.395723702 +0000 UTC m=+2459.589216678"
Jul 07 18:21:46.598743 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:46.598712    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-77b87f95c8-rnc8h_5250a2f2-851f-489b-960f-67d3bd599a25/console/0.log"
Jul 07 18:21:48.619780 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:48.619744    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8v7h_8d45c4ac-52f1-437e-ac8f-0ad7178ebdce/dns/0.log"
Jul 07 18:21:48.659141 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:48.659110    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-w8v7h_8d45c4ac-52f1-437e-ac8f-0ad7178ebdce/kube-rbac-proxy/0.log"
Jul 07 18:21:48.764831 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:48.764804    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-sg447_0a942f65-0608-4348-8c53-e24d8bdc5b35/dns-node-resolver/0.log"
Jul 07 18:21:49.362791 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:49.362749    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-8cff7fdd8-wdnqb_c2f2773e-208c-4eef-905f-18ca9e6d3745/registry/0.log"
Jul 07 18:21:49.389857 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:49.389832    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dztqc_cd13ff0d-7a6f-47dc-bbc8-e80be50b4c56/node-ca/0.log"
Jul 07 18:21:50.602665 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:50.602635    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8f24_d26f1587-52a4-4fd6-ba8d-4b3aba444dac/discovery/0.log"
Jul 07 18:21:50.783028 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:50.782992    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bx5sv_3a63bc7a-a09f-4c18-bcb6-6d675891f9e3/payload-pre-processing/0.log"
Jul 07 18:21:50.829738 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:50.829695    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mbmzm_0ce33647-f4df-4c86-8c81-b110c3662d2e/payload-processing/0.log"
Jul 07 18:21:51.395417 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:51.395391    2567 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-99zpf/perf-node-gather-daemonset-kn8nn"
Jul 07 18:21:51.629850 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:51.629822    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9nwpp_3d927f87-d697-4ab2-97a0-5874af688f85/serve-healthcheck-canary/0.log"
Jul 07 18:21:52.456976 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:52.456944    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sllsj_317afbee-08a6-4031-aaf6-10aa095ee97e/kube-rbac-proxy/0.log"
Jul 07 18:21:52.481818 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:52.481792    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sllsj_317afbee-08a6-4031-aaf6-10aa095ee97e/exporter/0.log"
Jul 07 18:21:52.510389 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:52.510369    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sllsj_317afbee-08a6-4031-aaf6-10aa095ee97e/extractor/0.log"
Jul 07 18:21:55.321591 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.321510    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8f24_d26f1587-52a4-4fd6-ba8d-4b3aba444dac/discovery/0.log"
Jul 07 18:21:55.388025 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.387999    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b964f5f4-d5t6v_007bb1ac-4b24-4283-be4e-a17c129b96a8/manager/0.log"
Jul 07 18:21:55.467995 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.467963    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bx5sv_3a63bc7a-a09f-4c18-bcb6-6d675891f9e3/payload-pre-processing/0.log"
Jul 07 18:21:55.505938 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.505907    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mbmzm_0ce33647-f4df-4c86-8c81-b110c3662d2e/payload-processing/0.log"
Jul 07 18:21:55.724455 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.724426    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-wp984_5450e2a0-22e5-434f-a380-5dfaa3caacae/manager/0.log"
Jul 07 18:21:55.747985 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:55.747963    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-d698b7b5d-wp984_5450e2a0-22e5-434f-a380-5dfaa3caacae/copy-manifests/0.log"
Jul 07 18:21:56.832997 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:56.832915    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-p8f24_d26f1587-52a4-4fd6-ba8d-4b3aba444dac/discovery/0.log"
Jul 07 18:21:56.977854 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:56.977824    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-bx5sv_3a63bc7a-a09f-4c18-bcb6-6d675891f9e3/payload-pre-processing/0.log"
Jul 07 18:21:57.017729 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:57.017703    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-mbmzm_0ce33647-f4df-4c86-8c81-b110c3662d2e/payload-processing/0.log"
Jul 07 18:21:57.064031 ip-10-0-143-89 kubenswrapper[2567]: I0707 18:21:57.063988    2567 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-85d9cbc876-9wh57_425b600b-2793-411e-803d-80f0958056db/manager/0.log"