Jul 09 14:53:01.956721 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 09 14:53:01.956730 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 09 14:53:01.956737 ip-10-0-129-1 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 09 14:53:01.956957 ip-10-0-129-1 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 09 14:53:12.006291 ip-10-0-129-1 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 09 14:53:12.006308 ip-10-0-129-1 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 4bf14014fd9a453c9833665c7626fdea --
Jul 09 14:55:09.456286 ip-10-0-129-1 systemd[1]: Starting Kubernetes Kubelet...
Jul 09 14:55:09.895018 ip-10-0-129-1 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:09.895018 ip-10-0-129-1 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 09 14:55:09.895018 ip-10-0-129-1 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:09.895018 ip-10-0-129-1 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 09 14:55:09.895018 ip-10-0-129-1 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 09 14:55:09.896822 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.896731    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 09 14:55:09.902933 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902908    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.902933 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902929    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.902933 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902934    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.902933 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902937    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.902933 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902941    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902945    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902949    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902953    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902957    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902961    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902964    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902969    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902973    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902977    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.902981    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903002    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903007    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903011    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903017    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903023    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903028    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903032    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903036    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.903231 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903041    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903047    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903051    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903055    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903059    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903063    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903067    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903070    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903074    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903078    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903082    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903086    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903090    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903094    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903098    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903103    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903108    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903112    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903117    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903121    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.904059 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903125    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903129    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903133    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903137    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903142    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903146    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903150    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903154    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903158    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903162    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903167    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903171    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903175    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903181    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903185    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903189    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903193    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903197    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903201    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903206    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903210    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.904904 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903214    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903218    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903223    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903227    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903230    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903234    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903239    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903247    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903253    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903258    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903263    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903267    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903271    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903276    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903280    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903284    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903288    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903292    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903296    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903300    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.905804 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903305    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903311    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903317    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903321    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903326    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903330    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903334    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903338    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903342    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903346    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903350    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903354    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903358    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903362    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.903366    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904539    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904550    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904554    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904560    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.906686 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904565    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904570    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904575    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904579    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904583    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904587    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904591    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904595    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904600    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904605    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904609    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904613    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904617    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904622    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904627    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904631    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904636    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904640    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904644    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904649    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.907648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904653    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904658    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904662    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904666    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904670    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904675    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904679    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904683    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904689    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904693    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904697    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904702    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904706    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904711    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904716    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904720    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904724    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904728    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904732    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904736    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.908201 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904740    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904744    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904748    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904752    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904756    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904761    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904765    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904769    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904773    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904777    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904782    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904785    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904790    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904794    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904798    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904802    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904806    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904810    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904814    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.908751 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904818    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904822    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904827    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904831    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904836    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904840    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904844    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904848    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904853    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904857    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904861    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904865    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904869    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904873    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904877    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904881    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904885    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904889    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904893    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.909296 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904897    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904904    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904909    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904913    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904920    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904925    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904930    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904935    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904939    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904944    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904950    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904955    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904960    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904965    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904970    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904974    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.904979    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905602    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905611    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.909781 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905616    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905620    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905626    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905630    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905635    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905639    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905643    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905648    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905653    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905656    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905661    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905665    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905669    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905674    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905678    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905682    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905686    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905690    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905694    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.910261 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905698    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905703    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905707    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905711    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905715    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905719    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905723    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905727    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905731    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905738    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905742    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905746    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905750    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905755    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905759    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905763    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905768    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905772    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905780    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.910726 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905786    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905791    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905795    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905799    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905803    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905807    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905811    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905815    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905821    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905827    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905832    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905837    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905841    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905846    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905850    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905855    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905859    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905863    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905867    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905870    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.911208 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905874    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905878    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905884    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905888    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905893    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905897    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905901    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905905    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905909    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905913    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905918    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905922    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905926    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905930    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905934    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905938    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905942    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905946    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905950    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905954    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.911697 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905958    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905962    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905966    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905970    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905974    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905979    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.905983    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906013    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906019    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906023    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906027    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906032    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906035    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906039    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906045    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906049    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906054    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906058    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.906062    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906164    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906176    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 09 14:55:09.912214 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906185    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906192    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906200    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906205    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906211    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906217    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906222    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906227    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906232    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906237    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906242    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906247    2578 flags.go:64] FLAG: --cgroup-root=""
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906252    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906257    2578 flags.go:64] FLAG: --client-ca-file=""
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906261    2578 flags.go:64] FLAG: --cloud-provider="external"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906266    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906271    2578 flags.go:64] FLAG: --cluster-domain=""
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906276    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906281    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906286    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906291    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906297    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906302    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 09 14:55:09.912719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906306    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906312    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906318    2578 flags.go:64] FLAG: --contention-profiling="false"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906323    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906328    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906333    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906337    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906344    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906349    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906353    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906358    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906362    2578 flags.go:64] FLAG: --enable-server="true"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906368    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906376    2578 flags.go:64] FLAG: --event-burst="100"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906381    2578 flags.go:64] FLAG: --event-qps="50"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906385    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906390    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906394    2578 flags.go:64] FLAG: --eviction-hard=""
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906400    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906405    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906410    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906415    2578 flags.go:64] FLAG: --eviction-soft=""
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906419    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906424    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906428    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 09 14:55:09.913347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906433    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906438    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906442    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906446    2578 flags.go:64] FLAG: --feature-gates=""
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906452    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906457    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906462    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906467    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906472    2578 flags.go:64] FLAG: --healthz-port="10248"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906478    2578 flags.go:64] FLAG: --help="false"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906483    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-129-1.ec2.internal"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906488    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906493    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906498    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906503    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906509    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906513    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906518    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906522    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906527    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906533    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906538    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906543    2578 flags.go:64] FLAG: --kube-reserved=""
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906548    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 09 14:55:09.913961 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906552    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906557    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906561    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906566    2578 flags.go:64] FLAG: --lock-file=""
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906570    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906575    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906579    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906589    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906593    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906598    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906602    2578 flags.go:64] FLAG: --logging-format="text"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906606    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906612    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906616    2578 flags.go:64] FLAG: --manifest-url=""
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906621    2578 flags.go:64] FLAG: --manifest-url-header=""
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906628    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906633    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906640    2578 flags.go:64] FLAG: --max-pods="110"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906645    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906650    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906654    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906659    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906663    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906668    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906673    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 09 14:55:09.914596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906684    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906689    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906693    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906698    2578 flags.go:64] FLAG: --pod-cidr=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906703    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906710    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906714    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906720    2578 flags.go:64] FLAG: --pods-per-core="0"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906724    2578 flags.go:64] FLAG: --port="10250"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906729    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906733    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0e5c1aba6d30ff307"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906739    2578 flags.go:64] FLAG: --qos-reserved=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906744    2578 flags.go:64] FLAG: --read-only-port="10255"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906748    2578 flags.go:64] FLAG: --register-node="true"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906753    2578 flags.go:64] FLAG: --register-with-taints=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906758    2578 flags.go:64] FLAG: --registry-burst="10"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906763    2578 flags.go:64] FLAG: --registry-qps="5"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906768    2578 flags.go:64] FLAG: --reserved-cpus=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906772    2578 flags.go:64] FLAG: --reserved-memory=""
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906778    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906783    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906788    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906792    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906797    2578 flags.go:64] FLAG: --runonce="false"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906802    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 09 14:55:09.915225 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906807    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906815    2578 flags.go:64] FLAG: --seccomp-default="false"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906820    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906824    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906829    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906834    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906838    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906843    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906847    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906852    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906856    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906861    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906866    2578 flags.go:64] FLAG: --system-cgroups=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906871    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906879    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906884    2578 flags.go:64] FLAG: --tls-cert-file=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906888    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906894    2578 flags.go:64] FLAG: --tls-min-version=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906899    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906903    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906908    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906912    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906917    2578 flags.go:64] FLAG: --v="2"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906923    2578 flags.go:64] FLAG: --version="false"
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906929    2578 flags.go:64] FLAG: --vmodule=""
Jul 09 14:55:09.915830 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906934    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.906939    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907143    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907151    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907156    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907161    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907165    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907170    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907176    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907180    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907185    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907189    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907193    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907197    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907201    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907205    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907210    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907214    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907218    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907222    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.916487 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907227    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907231    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907235    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907239    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907243    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907247    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907251    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907256    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907260    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907265    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907269    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907273    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907277    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907281    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907285    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907289    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907293    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907297    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907302    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907306    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.916979 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907311    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907315    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907320    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907323    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907327    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907331    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907335    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907342    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907348    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907353    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907357    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907362    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907366    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907370    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907375    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907379    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907384    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907388    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907394    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.917559 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907399    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907404    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907409    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907413    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907417    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907422    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907426    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907431    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907435    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907439    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907443    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907447    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907451    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907457    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907461    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907466    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907470    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907474    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907478    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907482    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.918040 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907486    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907490    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907494    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907498    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907502    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907507    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907511    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907516    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907520    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907524    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907528    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907533    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907536    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907543    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907549    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907553    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907556    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907561    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907565    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907569    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.918513 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907573    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.907577    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.908644    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.916291    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.916305    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.916323    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.916329    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916382    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916387    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916390    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916393    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916395    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916398    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916401    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916403    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.918999 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916406    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916408    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916411    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916414    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916417    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916420    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916422    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916426    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916430    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916433    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916436    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916438    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916441    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916443    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916447    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916450    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916453    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916456    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916459    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.919367 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916462    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916465    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916468    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916471    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916473    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916476    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916479    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916481    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916484    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916486    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916489    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916491    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916494    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916497    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916499    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916502    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916513    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916515    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916519    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916521    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.919841 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916524    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916526    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916529    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916532    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916534    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916537    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916540    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916543    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916545    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916547    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916550    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916552    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916555    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916557    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916560    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916562    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916565    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916568    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916570    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.920332 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916573    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916575    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916578    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916580    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916583    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916585    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916588    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916591    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916593    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916597    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916600    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916603    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916606    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916609    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916611    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916613    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916616    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916618    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916621    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916624    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.920789 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916626    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916628    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916631    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916633    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916636    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916638    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916641    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916644    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916646    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916649    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916651    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916653    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916656    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.916661    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916768    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 09 14:55:09.921342 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916773    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916776    2578 feature_gate.go:328] unrecognized feature gate: Example
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916779    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916782    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916785    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916787    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916790    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916792    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916795    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916798    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916801    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916804    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916806    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916809    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916811    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916814    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916816    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916819    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916821    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 09 14:55:09.921716 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916825    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916828    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916831    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916834    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916837    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916839    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916842    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916845    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916849    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916851    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916853    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916856    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916859    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916861    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916863    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916866    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916868    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916871    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916873    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 09 14:55:09.922176 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916875    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916878    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916880    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916882    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916885    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916888    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916890    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916893    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916895    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916898    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916900    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916902    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916905    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916907    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916909    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916911    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916914    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916916    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916919    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 09 14:55:09.922627 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916921    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916925    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916928    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916930    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916936    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916938    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916940    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916943    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916945    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916947    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916950    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916952    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916954    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916957    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916959    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916961    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916964    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916966    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 09 14:55:09.923091 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916969    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916972    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916974    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916976    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916979    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916981    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.916984    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917003    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917007    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917009    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917011    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917018    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917020    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917023    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917025    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917029    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917031    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917034    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917036    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917039    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917041    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 09 14:55:09.923586 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:09.917044    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.917049    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.917160    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.919486    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.920798    2578 server.go:1019] "Starting client certificate rotation"
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.920888    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:55:09.924105 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.920919    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 09 14:55:09.925139 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.925113    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:55:09.926798 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.926780    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 09 14:55:09.939916 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.939897    2578 log.go:25] "Validated CRI v1 runtime API"
Jul 09 14:55:09.941874 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.941858    2578 log.go:25] "Validated CRI v1 image API"
Jul 09 14:55:09.942627 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.942613    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 09 14:55:09.945006 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.944965    2578 fs.go:135] Filesystem UUIDs: map[112d344e-ade4-4c21-a92c-e9bdc15e8484:/dev/nvme0n1p4 256045f4-929a-4dce-8748-577bf491a8ce:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jul 09 14:55:09.945074 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.945006    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 09 14:55:09.952154 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.952047    2578 manager.go:216] Machine: {Timestamp:2026-07-09 14:55:09.948934 +0000 UTC m=+0.364119068 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101858 MemoryCapacity:32812158976 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec25c3d37347fab588f409e653d8ab46 SystemUUID:ec25c3d3-7347-fab5-88f4-09e653d8ab46 BootID:4bf14014-fd9a-453c-9833-665c7626fdea Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406081536 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f0:82:23:ac:97 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f0:82:23:ac:97 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fa:75:bb:c3:fa:e1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812158976 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 09 14:55:09.952154 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.952149    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 09 14:55:09.952254 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.952230    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 09 14:55:09.955906 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.955877    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 09 14:55:09.956056 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.955912    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-129-1.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 09 14:55:09.956700 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.956689    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jul 09 14:55:09.956736 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.956703    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jul 09 14:55:09.956736 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.956710    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:55:09.956786 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.956770    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:55:09.957710 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.957699    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 09 14:55:09.958589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.958580    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 09 14:55:09.961878 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.961866    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:55:09.962012 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.961983    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 09 14:55:09.962044 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962034    2578 kubelet.go:486] "Attempting to sync node with API server"
Jul 09 14:55:09.962044 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962044    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 09 14:55:09.962104 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962058    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 09 14:55:09.962104 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962067    2578 kubelet.go:398] "Adding apiserver pod source"
Jul 09 14:55:09.962104 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962075    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 09 14:55:09.962427 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962412    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:55:09.962507 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.962431    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 09 14:55:09.967712 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.967688    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 09 14:55:09.969476 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.969461    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 09 14:55:09.969545 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.969492    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 09 14:55:09.970681 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970668    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970691    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970701    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970710    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970722    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970730    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 09 14:55:09.970738 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970739    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 09 14:55:09.970912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970745    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 09 14:55:09.970912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970753    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 09 14:55:09.970912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970759    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 09 14:55:09.970912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970767    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 09 14:55:09.970912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.970773    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 09 14:55:09.971628 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.971618    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 09 14:55:09.971628 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.971628    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 09 14:55:09.973401 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.973373    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-129-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 09 14:55:09.973484 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.973378    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 09 14:55:09.975119 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.975107    2578 server.go:1268] "Started kubelet"
Jul 09 14:55:09.975222 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.975181    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 09 14:55:09.975274 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.975205    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 09 14:55:09.975336 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.975299    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 09 14:55:09.975510 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.975489    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-129-1.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 09 14:55:09.976108 ip-10-0-129-1 systemd[1]: Started Kubernetes Kubelet.
Jul 09 14:55:09.978627 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.978612    2578 server.go:310] "Adding debug handlers to kubelet server"
Jul 09 14:55:09.979136 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.979116    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 09 14:55:09.982599 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.982575    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 09 14:55:09.982762 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.982749    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 09 14:55:09.982820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.982763    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 09 14:55:09.982867 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.982842    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:09.983307 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983289    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 09 14:55:09.983307 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983303    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 09 14:55:09.983456 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983309    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 09 14:55:09.983456 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983420    2578 reconstruct.go:97] "Volume reconstruction finished"
Jul 09 14:55:09.983456 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983429    2578 reconciler.go:29] "Reconciler: start to sync state"
Jul 09 14:55:09.983635 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983614    2578 factory.go:55] Registering systemd factory
Jul 09 14:55:09.983718 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.983637    2578 factory.go:223] Registration of the systemd container factory successfully
Jul 09 14:55:09.984083 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984071    2578 factory.go:153] Registering CRI-O factory
Jul 09 14:55:09.984155 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984086    2578 factory.go:223] Registration of the crio container factory successfully
Jul 09 14:55:09.984155 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984154    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 09 14:55:09.984261 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984215    2578 factory.go:103] Registering Raw factory
Jul 09 14:55:09.984309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984266    2578 manager.go:1196] Started watching for new ooms in manager
Jul 09 14:55:09.984602 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984568    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-57hxl"
Jul 09 14:55:09.984838 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.984826    2578 manager.go:349] Starting recovery of all containers
Jul 09 14:55:09.987632 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.986927    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 09 14:55:09.987632 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.987558    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-129-1.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 09 14:55:09.988132 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.986982    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-1.ec2.internal.18c0a6da89495a8a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-1.ec2.internal,UID:ip-10-0-129-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-129-1.ec2.internal,},FirstTimestamp:2026-07-09 14:55:09.975083658 +0000 UTC m=+0.390268725,LastTimestamp:2026-07-09 14:55:09.975083658 +0000 UTC m=+0.390268725,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-1.ec2.internal,}"
Jul 09 14:55:09.991651 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.991623    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 09 14:55:09.995275 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.995122    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-57hxl"
Jul 09 14:55:09.996884 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:09.996861    2578 manager.go:354] Recovery completed
Jul 09 14:55:09.999508 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:09.999476    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 09 14:55:10.002461 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.002449    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.004405 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004391    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.004454 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004418    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.004454 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004429    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.004929 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004905    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 09 14:55:10.004929 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004912    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.004929 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004918    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 09 14:55:10.005121 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.004937    2578 state_mem.go:36] "Initialized new in-memory state store"
Jul 09 14:55:10.005624 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.005610    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.005680 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.005635    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.005680 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.005647    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.006154 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.006141    2578 policy_none.go:49] "None policy: Start"
Jul 09 14:55:10.006214 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.006160    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 09 14:55:10.006214 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.006174    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 09 14:55:10.006879 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.006817    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-129-1.ec2.internal.18c0a6da8b08c8c4  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-129-1.ec2.internal,UID:ip-10-0-129-1.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-129-1.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-129-1.ec2.internal,},FirstTimestamp:2026-07-09 14:55:10.004406468 +0000 UTC m=+0.419591662,LastTimestamp:2026-07-09 14:55:10.004406468 +0000 UTC m=+0.419591662,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-129-1.ec2.internal,}"
Jul 09 14:55:10.007251 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.007238    2578 policy_none.go:47] "Start"
Jul 09 14:55:10.040578 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.040561    2578 manager.go:337] "Starting Device Plugin manager"
Jul 09 14:55:10.040679 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.040597    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 09 14:55:10.040679 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.040645    2578 server.go:87] "Starting device plugin registration server"
Jul 09 14:55:10.040880 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.040867    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 09 14:55:10.040947 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.040882    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 09 14:55:10.041059 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.041043    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 09 14:55:10.041144 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.041120    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 09 14:55:10.041144 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.041133    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 09 14:55:10.041582 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.041561    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 09 14:55:10.041642 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.041620    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.117128 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.117097    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 09 14:55:10.118487 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.117135    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 09 14:55:10.118487 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.117156    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 09 14:55:10.118487 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.117186    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 09 14:55:10.119978 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.119960    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:10.141250 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.141230    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.142091 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.142072    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.142180 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.142102    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.142180 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.142112    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.142180 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.142133    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.154274 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.154228    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.154274 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.154249    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-129-1.ec2.internal\": node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.171064 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.171045    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.217797 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.217766    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"]
Jul 09 14:55:10.217865 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.217848    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.218603 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.218588    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.218652 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.218617    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.218652 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.218627    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.220016 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220004    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.220122 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.220160 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220134    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.220643 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220622    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.220643 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220635    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.220781 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220651    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.220781 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220654    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.220781 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220666    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.220781 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.220666    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.222077 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.222062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.222147 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.222084    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 09 14:55:10.222772 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.222755    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientMemory"
Jul 09 14:55:10.222846 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.222784    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasNoDiskPressure"
Jul 09 14:55:10.222846 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.222794    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeHasSufficientPID"
Jul 09 14:55:10.245675 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.245651    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.249856 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.249839    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-129-1.ec2.internal\" not found" node="ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.271613 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.271591    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.285613 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.285594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.285682 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.285620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.285682 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.285637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caf9e1426bf7d6e6ee3881921c5dfd0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"caf9e1426bf7d6e6ee3881921c5dfd0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.371935 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.371914    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.386346 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caf9e1426bf7d6e6ee3881921c5dfd0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"caf9e1426bf7d6e6ee3881921c5dfd0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.386422 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.386422 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386368    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.386422 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.386422 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386418    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/83bb47a9314a1bef5b5b1fd8f878114f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal\" (UID: \"83bb47a9314a1bef5b5b1fd8f878114f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.386566 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.386438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/caf9e1426bf7d6e6ee3881921c5dfd0e-config\") pod \"kube-apiserver-proxy-ip-10-0-129-1.ec2.internal\" (UID: \"caf9e1426bf7d6e6ee3881921c5dfd0e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.472816 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.472746    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.548249 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.548224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.552856 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.552696    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:10.573631 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.573609    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.674177 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.674145    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.774797 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.774714    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.875341 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.875312    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:10.920797 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.920775    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 09 14:55:10.921284 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:10.920919    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 09 14:55:10.976348 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:10.976321    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-129-1.ec2.internal\" not found"
Jul 09 14:55:11.000951 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.000916    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 14:50:10 +0000 UTC" deadline="2027-12-14 01:08:49.259631799 +0000 UTC"
Jul 09 14:55:11.000951 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.000945    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12538h13m38.258691272s"
Jul 09 14:55:11.007598 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.007574    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:11.014668 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.014639    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:11.083717 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.083691    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:11.096806 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.096780    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:55:11.097859 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.097845    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal"
Jul 09 14:55:11.113137 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.113115    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 09 14:55:11.156297 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:11.156259    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf9e1426bf7d6e6ee3881921c5dfd0e.slice/crio-fe6263fb1fb7e19485ef9a0df72d5961ca18ad239b0f1916e5fc249a658148fc WatchSource:0}: Error finding container fe6263fb1fb7e19485ef9a0df72d5961ca18ad239b0f1916e5fc249a658148fc: Status 404 returned error can't find the container with id fe6263fb1fb7e19485ef9a0df72d5961ca18ad239b0f1916e5fc249a658148fc
Jul 09 14:55:11.156654 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:11.156639    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83bb47a9314a1bef5b5b1fd8f878114f.slice/crio-8b6d94e02dd2b4927124cc1371b0e6a9eb80adf375515b724e28d2b868ff26b9 WatchSource:0}: Error finding container 8b6d94e02dd2b4927124cc1371b0e6a9eb80adf375515b724e28d2b868ff26b9: Status 404 returned error can't find the container with id 8b6d94e02dd2b4927124cc1371b0e6a9eb80adf375515b724e28d2b868ff26b9
Jul 09 14:55:11.164695 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.164675    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 14:55:11.337370 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.337300    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:11.963288 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.963251    2578 apiserver.go:52] "Watching apiserver"
Jul 09 14:55:11.972938 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.972906    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 09 14:55:11.973363 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.973339    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-hbxb5","openshift-image-registry/node-ca-fzfxb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal","openshift-multus/network-metrics-daemon-cqb5z","openshift-ovn-kubernetes/ovnkube-node-fx4gb","kube-system/global-pull-secret-syncer-k6swk","kube-system/konnectivity-agent-2ljtt","kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc","openshift-multus/multus-additional-cni-plugins-vjtwq","openshift-multus/multus-klqhj","openshift-network-diagnostics/network-check-target-76ps4","openshift-network-operator/iptables-alerter-jbr54","openshift-cluster-node-tuning-operator/tuned-nbmwb"]
Jul 09 14:55:11.974970 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.974935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:11.975107 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:11.975052    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:11.976428 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.976402    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:11.977958 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.977923    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:11.979412 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.979388    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.980731 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.980707    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:11.980822 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:11.980802    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:11.982361 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.982343    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:11.983733 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.983716    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 09 14:55:11.983933 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.983912    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bvxmp\""
Jul 09 14:55:11.984272 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.984247    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.984368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.984288    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 09 14:55:11.984432 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.984365    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 09 14:55:11.985041 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.985004    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.985158    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.985671    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986607    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986639    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986696    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986753    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986786    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986840    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 09 14:55:11.986984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.986898    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 09 14:55:11.987522 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.987119    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-f4bdd\""
Jul 09 14:55:11.987953 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.987935    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klqhj"
Jul 09 14:55:11.988192 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988174    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 09 14:55:11.988295 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988272    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 09 14:55:11.988955 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988578    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 09 14:55:11.988955 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988654    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 09 14:55:11.988955 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-thncm\""
Jul 09 14:55:11.988955 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.988875    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 09 14:55:11.989656 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.989633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:11.989771 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:11.989709    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:11.991811 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.991654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-lzfpr\""
Jul 09 14:55:11.991943 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.991906    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 09 14:55:11.992318 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.992298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:11.994954 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.994862    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:11.995447 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.995426    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 09 14:55:11.997929 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.997906    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 09 14:55:11.997929 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.997916    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dptzf\""
Jul 09 14:55:11.998442 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-script-lib\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998539 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998462    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:11.998539 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-node-log\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998539 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998521    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998558    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a78e5-6aab-4010-8d11-2e653d030f2c-tmp-dir\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlqlc\" (UniqueName: \"kubernetes.io/projected/ed9a78e5-6aab-4010-8d11-2e653d030f2c-kube-api-access-xlqlc\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-dbus\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-socket-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94224c1b-197b-4e14-9585-802eebd128c6-agent-certs\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998653    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94224c1b-197b-4e14-9585-802eebd128c6-konnectivity-ca\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-netns\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998689    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998725    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxp9t\" (UniqueName: \"kubernetes.io/projected/56ddfb46-e191-4664-bbcf-901f93b5b7cf-kube-api-access-qxp9t\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998757    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed9a78e5-6aab-4010-8d11-2e653d030f2c-hosts-file\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998780    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-g5sdv\""
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-systemd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-ovn\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998851    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-log-socket\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.998964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-netd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.998980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999015    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-env-overrides\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633027c-66fd-4326-9488-ef6da09462bd-serviceca\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999078    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zld47\" (UniqueName: \"kubernetes.io/projected/f633027c-66fd-4326-9488-ef6da09462bd-kube-api-access-zld47\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999156    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999190    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-device-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999221    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-sys-fs\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999247    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-slash\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999280    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-etc-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999314    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovn-node-metrics-cert\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999335    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 09 14:55:11.999343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999346    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-kubelet-config\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999377    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-var-lib-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hdx2\" (UniqueName: \"kubernetes.io/projected/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-kube-api-access-2hdx2\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633027c-66fd-4326-9488-ef6da09462bd-host\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999448    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7t98\" (UniqueName: \"kubernetes.io/projected/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kube-api-access-r7t98\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999472    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-kubelet\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999490    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-bin\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999509    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-config\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999532    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-registration-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999543    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999551    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-systemd-units\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:11.999974 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:11.999573    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.000366 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.000237    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:55:12.000428 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.000408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 09 14:55:12.000609 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.000588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vbpgf\""
Jul 09 14:55:12.000889 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.000870    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:55:12.001014 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.000875    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-995vz\""
Jul 09 14:55:12.001905 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.001883    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qhkfp\""
Jul 09 14:55:12.004080 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.003985    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 09 14:55:12.004560 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.004542    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 09 14:55:12.009576 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.009554    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 09 14:55:12.038706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.038682    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf7wx"
Jul 09 14:55:12.055723 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.055379    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vf7wx"
Jul 09 14:55:12.085352 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.085329    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 09 14:55:12.099815 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-env-overrides\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.099924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633027c-66fd-4326-9488-ef6da09462bd-serviceca\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.099924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.099924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099881    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-sys-fs\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.099924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-cnibin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-etc-kubernetes\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhc7r\" (UniqueName: \"kubernetes.io/projected/0c2f8c91-5a09-4c97-9446-0ca58af796b7-kube-api-access-jhc7r\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.099996    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-slash\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100041    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-etc-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovn-node-metrics-cert\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100214    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-hostroot\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100262    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-systemd\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100292    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-sys\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100328    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-var-lib-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100356    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hdx2\" (UniqueName: \"kubernetes.io/projected/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-kube-api-access-2hdx2\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100383    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjt5x\" (UniqueName: \"kubernetes.io/projected/62a37548-2d95-46fe-972c-f7acfc48359e-kube-api-access-tjt5x\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100409    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-kubelet\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-registration-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100482    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-cni-binary-copy\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100535    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-systemd-units\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.100630 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100614    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100643    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/febb7629-0e56-4277-83ff-d004589a462e-host-slash\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100724    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-dbus\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100752    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100778    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100807    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100831    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-os-release\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100856    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-socket-dir-parent\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100862    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-registration-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-conf-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.100920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94224c1b-197b-4e14-9585-802eebd128c6-agent-certs\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:12.101327 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.101274    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 09 14:55:12.101964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.101943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-netns\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.102070 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.101980    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102070 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102004    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-daemon-config\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102070 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102030    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-host\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102070 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102053    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-cnibin\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102093    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-ovn\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102149    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zld47\" (UniqueName: \"kubernetes.io/projected/f633027c-66fd-4326-9488-ef6da09462bd-kube-api-access-zld47\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102169    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-var-lib-kubelet\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102216    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-device-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102241    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-system-cni-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/febb7629-0e56-4277-83ff-d004589a462e-iptables-alerter-script\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.102289 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102288    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysconfig\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-conf\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102334    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-run\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102355    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-lib-modules\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102381    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-kubelet-config\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-os-release\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102431    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-k8s-cni-cncf-io\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102455    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-multus-certs\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-tmp\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633027c-66fd-4326-9488-ef6da09462bd-host\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102530    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-netns\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4trmh\" (UniqueName: \"kubernetes.io/projected/0985c491-382a-4c3a-940c-7e1e3d6b0925-kube-api-access-4trmh\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-modprobe-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.102761 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102604    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-kubelet\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102795    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-bin\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102828    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-config\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102864    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-bin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-script-lib\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-kubernetes\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-node-log\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.102972    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a78e5-6aab-4010-8d11-2e653d030f2c-tmp-dir\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlqlc\" (UniqueName: \"kubernetes.io/projected/ed9a78e5-6aab-4010-8d11-2e653d030f2c-kube-api-access-xlqlc\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-socket-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-multus\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103284    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8g9w\" (UniqueName: \"kubernetes.io/projected/febb7629-0e56-4277-83ff-d004589a462e-kube-api-access-p8g9w\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103321    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94224c1b-197b-4e14-9585-802eebd128c6-konnectivity-ca\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103345    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103374    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-system-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-tuned\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7t98\" (UniqueName: \"kubernetes.io/projected/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kube-api-access-r7t98\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.103540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxp9t\" (UniqueName: \"kubernetes.io/projected/56ddfb46-e191-4664-bbcf-901f93b5b7cf-kube-api-access-qxp9t\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103472    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed9a78e5-6aab-4010-8d11-2e653d030f2c-hosts-file\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103498    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-systemd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-log-socket\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-netd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103663    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-netd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-kubelet\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103744    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-netns\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.103794    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-ovn\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.104104    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.104159    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-device-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.104217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-kubelet-config\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.104398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.104262    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f633027c-66fd-4326-9488-ef6da09462bd-host\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.105035 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.104711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-env-overrides\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105186 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105161    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f633027c-66fd-4326-9488-ef6da09462bd-serviceca\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.105274 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.105337 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-sys-fs\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.105337 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105311    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-slash\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105446 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-etc-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105446 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105391    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-var-lib-openvswitch\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105692 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.105672    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:12.105780 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.105763    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:12.605735315 +0000 UTC m=+3.020920371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:12.105854 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105816    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-systemd-units\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105910 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.105854    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.105967 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.105916    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:12.105967 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.105958    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:12.605945432 +0000 UTC m=+3.021130495 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:12.106175 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.106147    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/d38b4155-289f-46f0-944a-35d04d5e9631-dbus\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.106351 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.106331    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovn-node-metrics-cert\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.106442 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.106372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-cni-bin\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.106887 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.106861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-config\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107151    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-node-log\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107189    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56ddfb46-e191-4664-bbcf-901f93b5b7cf-ovnkube-script-lib\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-log-socket\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ed9a78e5-6aab-4010-8d11-2e653d030f2c-hosts-file\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107265    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-run-systemd\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107335    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-etc-selinux\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107347    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-socket-dir\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107395    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56ddfb46-e191-4664-bbcf-901f93b5b7cf-host-run-ovn-kubernetes\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.107552 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107433    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ed9a78e5-6aab-4010-8d11-2e653d030f2c-tmp-dir\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.108360 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.107622    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/94224c1b-197b-4e14-9585-802eebd128c6-konnectivity-ca\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:12.110946 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.110923    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/94224c1b-197b-4e14-9585-802eebd128c6-agent-certs\") pod \"konnectivity-agent-2ljtt\" (UID: \"94224c1b-197b-4e14-9585-802eebd128c6\") " pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:12.123210 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.123165    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"83bb47a9314a1bef5b5b1fd8f878114f","Type":"ContainerStarted","Data":"8b6d94e02dd2b4927124cc1371b0e6a9eb80adf375515b724e28d2b868ff26b9"}
Jul 09 14:55:12.124893 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.124806    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"caf9e1426bf7d6e6ee3881921c5dfd0e","Type":"ContainerStarted","Data":"fe6263fb1fb7e19485ef9a0df72d5961ca18ad239b0f1916e5fc249a658148fc"}
Jul 09 14:55:12.138817 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.138722    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxp9t\" (UniqueName: \"kubernetes.io/projected/56ddfb46-e191-4664-bbcf-901f93b5b7cf-kube-api-access-qxp9t\") pod \"ovnkube-node-fx4gb\" (UID: \"56ddfb46-e191-4664-bbcf-901f93b5b7cf\") " pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.141683 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.141655    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7t98\" (UniqueName: \"kubernetes.io/projected/7ca606c5-aeb0-46b7-b7fb-d96acf2171cd-kube-api-access-r7t98\") pod \"aws-ebs-csi-driver-node-2nlrc\" (UID: \"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.142171 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.142149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlqlc\" (UniqueName: \"kubernetes.io/projected/ed9a78e5-6aab-4010-8d11-2e653d030f2c-kube-api-access-xlqlc\") pod \"node-resolver-hbxb5\" (UID: \"ed9a78e5-6aab-4010-8d11-2e653d030f2c\") " pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.143474 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.143452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zld47\" (UniqueName: \"kubernetes.io/projected/f633027c-66fd-4326-9488-ef6da09462bd-kube-api-access-zld47\") pod \"node-ca-fzfxb\" (UID: \"f633027c-66fd-4326-9488-ef6da09462bd\") " pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.145353 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.145291    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hdx2\" (UniqueName: \"kubernetes.io/projected/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-kube-api-access-2hdx2\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:12.204896 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.204857    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.204920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.204978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-os-release\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.205113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205074    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-socket-dir-parent\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.205113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205100    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-conf-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.205398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205134    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.205398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205344    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-daemon-config\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.205398 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-host\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205553 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-cnibin\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205553 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205553 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-var-lib-kubelet\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205553 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205522    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-system-cni-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205557    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/febb7629-0e56-4277-83ff-d004589a462e-iptables-alerter-script\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.205805 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysconfig\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205858 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205811    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-conf\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205858 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-run\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205971 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-lib-modules\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.205971 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-os-release\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.205971 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205941    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-k8s-cni-cncf-io\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.206125 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.205974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-multus-certs\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.206636 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.206596    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-cnibin\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.207364 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.207323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-binary-copy\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.207888 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.207866    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.208500 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.208457    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/62a37548-2d95-46fe-972c-f7acfc48359e-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.208626 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.208608    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-os-release\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.208698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.208687    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-socket-dir-parent\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.208771 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.208754    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-conf-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.208848 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.208828    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.209476 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.209454    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-multus-daemon-config\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.209576 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.209549    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-host\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.209739 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.209719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-conf\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.209909 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.209887    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-tuning-conf-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.210026 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.209972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-var-lib-kubelet\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.210093 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.210028    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-system-cni-dir\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.210640 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.210590    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/febb7629-0e56-4277-83ff-d004589a462e-iptables-alerter-script\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.210768 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.210751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysconfig\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.210855 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.210839    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/62a37548-2d95-46fe-972c-f7acfc48359e-os-release\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.210916 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.210907    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-run\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211114 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-lib-modules\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211196 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211172    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-k8s-cni-cncf-io\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211258 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211231    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-multus-certs\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211258 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-tmp\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-netns\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211326    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4trmh\" (UniqueName: \"kubernetes.io/projected/0985c491-382a-4c3a-940c-7e1e3d6b0925-kube-api-access-4trmh\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211352    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-modprobe-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211387    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-bin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-kubernetes\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211441    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-run-netns\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211455    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-multus\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211487    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8g9w\" (UniqueName: \"kubernetes.io/projected/febb7629-0e56-4277-83ff-d004589a462e-kube-api-access-p8g9w\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.211521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-system-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211545    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-tuned\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-cnibin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211626    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-etc-kubernetes\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211651    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhc7r\" (UniqueName: \"kubernetes.io/projected/0c2f8c91-5a09-4c97-9446-0ca58af796b7-kube-api-access-jhc7r\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-hostroot\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211719    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-systemd\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-sys\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjt5x\" (UniqueName: \"kubernetes.io/projected/62a37548-2d95-46fe-972c-f7acfc48359e-kube-api-access-tjt5x\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211816    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-kubelet\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211847    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-cni-binary-copy\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:12.211972 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.211956    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/febb7629-0e56-4277-83ff-d004589a462e-host-slash\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.212246 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.212084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/febb7629-0e56-4277-83ff-d004589a462e-host-slash\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.212531 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.212506    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-modprobe-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.212626 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.212592    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-bin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.212692 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.212669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-kubernetes\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.212748 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.212718    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-cni-multus\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.213509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213015    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-systemd\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.213509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213043    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-sys\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.213509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213144    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-system-cni-dir\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.213509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213382    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-host-var-lib-kubelet\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.213509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213422    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-etc-kubernetes\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.213800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-cnibin\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.213800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213711    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-sysctl-d\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.213800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.213767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0985c491-382a-4c3a-940c-7e1e3d6b0925-hostroot\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.214303 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.214283    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0985c491-382a-4c3a-940c-7e1e3d6b0925-cni-binary-copy\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.216073 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.216036    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-tmp\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.216470 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.216445    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0c2f8c91-5a09-4c97-9446-0ca58af796b7-etc-tuned\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.230138 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.229488    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:12.230138 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.229518    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:12.230138 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.229534    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:12.230138 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.229599    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:12.72958097 +0000 UTC m=+3.144766027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:12.233057 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.233008    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjt5x\" (UniqueName: \"kubernetes.io/projected/62a37548-2d95-46fe-972c-f7acfc48359e-kube-api-access-tjt5x\") pod \"multus-additional-cni-plugins-vjtwq\" (UID: \"62a37548-2d95-46fe-972c-f7acfc48359e\") " pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.234981 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.234954    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8g9w\" (UniqueName: \"kubernetes.io/projected/febb7629-0e56-4277-83ff-d004589a462e-kube-api-access-p8g9w\") pod \"iptables-alerter-jbr54\" (UID: \"febb7629-0e56-4277-83ff-d004589a462e\") " pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.236424 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.236397    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4trmh\" (UniqueName: \"kubernetes.io/projected/0985c491-382a-4c3a-940c-7e1e3d6b0925-kube-api-access-4trmh\") pod \"multus-klqhj\" (UID: \"0985c491-382a-4c3a-940c-7e1e3d6b0925\") " pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.237387 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.237358    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhc7r\" (UniqueName: \"kubernetes.io/projected/0c2f8c91-5a09-4c97-9446-0ca58af796b7-kube-api-access-jhc7r\") pod \"tuned-nbmwb\" (UID: \"0c2f8c91-5a09-4c97-9446-0ca58af796b7\") " pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.290915 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.290884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hbxb5"
Jul 09 14:55:12.302399 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.302363    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:12.314719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.314492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:12.323863 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.323834    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-fzfxb"
Jul 09 14:55:12.332439 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.332416    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc"
Jul 09 14:55:12.348333 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.348312    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-vjtwq"
Jul 09 14:55:12.356322 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.356297    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-klqhj"
Jul 09 14:55:12.367513 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.367488    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jbr54"
Jul 09 14:55:12.374544 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.374520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nbmwb"
Jul 09 14:55:12.464968 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.464883    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 09 14:55:12.615142 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.615104    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:12.615328 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.615151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:12.615328 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.615253    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:12.615328 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.615267    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:12.615328 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.615324    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:13.615306109 +0000 UTC m=+4.030491165 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:12.615475 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.615341    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:13.61533356 +0000 UTC m=+4.030518616 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:12.817226 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:12.817132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:12.817392 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.817289    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:12.817392 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.817321    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:12.817392 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.817337    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:12.817523 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:12.817415    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:13.81739276 +0000 UTC m=+4.232577833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:13.058005 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.057959    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:12 +0000 UTC" deadline="2028-01-01 19:02:11.377177283 +0000 UTC"
Jul 09 14:55:13.058005 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.058010    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12988h6m58.319185007s"
Jul 09 14:55:13.119234 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.119132    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:13.119403 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.119261    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:13.410866 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:13.410827    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf633027c_66fd_4326_9488_ef6da09462bd.slice/crio-68bf93f8452fbdea1c8e8f60d1b74f8a0a061a88957841f94d54dd54d269f199 WatchSource:0}: Error finding container 68bf93f8452fbdea1c8e8f60d1b74f8a0a061a88957841f94d54dd54d269f199: Status 404 returned error can't find the container with id 68bf93f8452fbdea1c8e8f60d1b74f8a0a061a88957841f94d54dd54d269f199
Jul 09 14:55:13.440361 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:13.440320    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c2f8c91_5a09_4c97_9446_0ca58af796b7.slice/crio-35c12feb3eb9f7e2c3a51f110f2566f4a1a4e582c34eaf22ece701b570ef007b WatchSource:0}: Error finding container 35c12feb3eb9f7e2c3a51f110f2566f4a1a4e582c34eaf22ece701b570ef007b: Status 404 returned error can't find the container with id 35c12feb3eb9f7e2c3a51f110f2566f4a1a4e582c34eaf22ece701b570ef007b
Jul 09 14:55:13.442492 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:13.442471    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ca606c5_aeb0_46b7_b7fb_d96acf2171cd.slice/crio-ed680758279d9435e65cd483559f077d7c37c599d118d00b7354b71e675b5a9a WatchSource:0}: Error finding container ed680758279d9435e65cd483559f077d7c37c599d118d00b7354b71e675b5a9a: Status 404 returned error can't find the container with id ed680758279d9435e65cd483559f077d7c37c599d118d00b7354b71e675b5a9a
Jul 09 14:55:13.443739 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:13.443700    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0985c491_382a_4c3a_940c_7e1e3d6b0925.slice/crio-5b16804b19c77b90c2fa325cb84c75148ae0c5cb25f38f4dbcdad8b033ec5c25 WatchSource:0}: Error finding container 5b16804b19c77b90c2fa325cb84c75148ae0c5cb25f38f4dbcdad8b033ec5c25: Status 404 returned error can't find the container with id 5b16804b19c77b90c2fa325cb84c75148ae0c5cb25f38f4dbcdad8b033ec5c25
Jul 09 14:55:13.446462 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:13.445488    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94224c1b_197b_4e14_9585_802eebd128c6.slice/crio-01fae92f5bcb95b45c3452cc2798e95f33a70aeb6b90f638deec2c552027c7c0 WatchSource:0}: Error finding container 01fae92f5bcb95b45c3452cc2798e95f33a70aeb6b90f638deec2c552027c7c0: Status 404 returned error can't find the container with id 01fae92f5bcb95b45c3452cc2798e95f33a70aeb6b90f638deec2c552027c7c0
Jul 09 14:55:13.624347 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.624155    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:13.624511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.624369    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:13.624511 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.624288    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:13.624511 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.624472    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:13.624511 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.624502    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:15.624480442 +0000 UTC m=+6.039665498 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:13.624736 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.624522    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:15.624510883 +0000 UTC m=+6.039695940 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:13.826523 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:13.826491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:13.826716 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.826691    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:13.826794 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.826726    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:13.826794 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.826740    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:13.826881 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:13.826814    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:15.826793851 +0000 UTC m=+6.241978909 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:14.058821 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.058674    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 14:50:12 +0000 UTC" deadline="2028-04-12 15:58:37.093267826 +0000 UTC"
Jul 09 14:55:14.058821 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.058738    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15433h3m23.034535692s"
Jul 09 14:55:14.120829 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.120038    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:14.120829 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:14.120209    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:14.120829 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.120651    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:14.120829 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:14.120755    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:14.134425 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.134389    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerStarted","Data":"16fd75fb8777181a91536d1c43a0eb256285dba41ee13e56721425ca15acc7b2"}
Jul 09 14:55:14.136443 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.136414    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzfxb" event={"ID":"f633027c-66fd-4326-9488-ef6da09462bd","Type":"ContainerStarted","Data":"68bf93f8452fbdea1c8e8f60d1b74f8a0a061a88957841f94d54dd54d269f199"}
Jul 09 14:55:14.138410 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.138329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbmwb" event={"ID":"0c2f8c91-5a09-4c97-9446-0ca58af796b7","Type":"ContainerStarted","Data":"35c12feb3eb9f7e2c3a51f110f2566f4a1a4e582c34eaf22ece701b570ef007b"}
Jul 09 14:55:14.144546 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.144467    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klqhj" event={"ID":"0985c491-382a-4c3a-940c-7e1e3d6b0925","Type":"ContainerStarted","Data":"5b16804b19c77b90c2fa325cb84c75148ae0c5cb25f38f4dbcdad8b033ec5c25"}
Jul 09 14:55:14.147004 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.146974    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc" event={"ID":"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd","Type":"ContainerStarted","Data":"ed680758279d9435e65cd483559f077d7c37c599d118d00b7354b71e675b5a9a"}
Jul 09 14:55:14.149985 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.149957    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hbxb5" event={"ID":"ed9a78e5-6aab-4010-8d11-2e653d030f2c","Type":"ContainerStarted","Data":"cf508e3969b96b78d869f117b2d76547deec5e4c394b4f9bef5f09be4b1d417e"}
Jul 09 14:55:14.153608 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.153577    2578 generic.go:356] "Generic (PLEG): container finished" podID="83bb47a9314a1bef5b5b1fd8f878114f" containerID="f6d9513c0ad0328f6e07f4beb1a98a5c5f89b4464e0b71e5ec4c9ba7eebf1c3d" exitCode=0
Jul 09 14:55:14.153887 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.153661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"83bb47a9314a1bef5b5b1fd8f878114f","Type":"ContainerDied","Data":"f6d9513c0ad0328f6e07f4beb1a98a5c5f89b4464e0b71e5ec4c9ba7eebf1c3d"}
Jul 09 14:55:14.161708 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.161681    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" event={"ID":"caf9e1426bf7d6e6ee3881921c5dfd0e","Type":"ContainerStarted","Data":"1868b93f8f5857b6cb02c88692a7a886353bb89c9e5fba59adc10a65463cf648"}
Jul 09 14:55:14.184779 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.184749    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2ljtt" event={"ID":"94224c1b-197b-4e14-9585-802eebd128c6","Type":"ContainerStarted","Data":"01fae92f5bcb95b45c3452cc2798e95f33a70aeb6b90f638deec2c552027c7c0"}
Jul 09 14:55:14.191297 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.191234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jbr54" event={"ID":"febb7629-0e56-4277-83ff-d004589a462e","Type":"ContainerStarted","Data":"dfe6e1014efc9755a5024e8e7c0391dde28b8301e8fbbaa653aa896e91487d07"}
Jul 09 14:55:14.194054 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:14.193931    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"3912101524c29b17b3d4ea8243f97b19818fdc63676aa06ebf396e3f3509cb0d"}
Jul 09 14:55:15.118358 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.118321    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:15.118837 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.118459    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:15.212053 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.212014    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" event={"ID":"83bb47a9314a1bef5b5b1fd8f878114f","Type":"ContainerStarted","Data":"eb9937746f118826435ec7ef51b5a8bf13ce7a882fe2d9036ff9d620fa3e62bd"}
Jul 09 14:55:15.233648 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.233583    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-129-1.ec2.internal" podStartSLOduration=4.23356148 podStartE2EDuration="4.23356148s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:14.200231132 +0000 UTC m=+4.615416206" watchObservedRunningTime="2026-07-09 14:55:15.23356148 +0000 UTC m=+5.648746561"
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.646549    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.646610    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.646804    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.646871    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.646849506 +0000 UTC m=+10.062034566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.646938    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:15.647358 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.646973    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.646961823 +0000 UTC m=+10.062146886 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:15.848773 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:15.847803    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:15.848773 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.847969    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:15.848773 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.847991    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:15.848773 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.848005    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:15.848773 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:15.848094    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:19.848072556 +0000 UTC m=+10.263257617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:16.121721 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:16.120855    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:16.121721 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:16.121015    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:16.121721 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:16.121451    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:16.121721 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:16.121553    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:17.118291 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:17.118258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:17.118494 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:17.118393    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:18.117736 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:18.117703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:18.118221 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:18.117854    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:18.118292 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:18.118257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:18.118369 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:18.118345    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:19.117725 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:19.117689    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:19.117929 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.117827    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:19.686425 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:19.686383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:19.686635 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:19.686447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:19.686635 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.686560    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:19.686635 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.686560    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:19.686635 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.686621    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.686602492 +0000 UTC m=+18.101787550 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:19.686783 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.686640    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.68663038 +0000 UTC m=+18.101815435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:19.888197 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:19.888156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:19.888813 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.888384    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:19.888813 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.888417    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:19.888813 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.888433    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:19.888813 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:19.888489    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:27.88847363 +0000 UTC m=+18.303658689 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:20.119076 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:20.118971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:20.119567 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:20.119137    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:20.119567 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:20.119189    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:20.119567 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:20.119333    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:21.117496 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:21.117465    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:21.117658 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:21.117575    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:22.117773 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:22.117744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:22.118348 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:22.117754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:22.118348 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:22.118056    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:22.118348 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:22.118113    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:23.118492 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:23.117971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:23.118492 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:23.118124    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:24.119423 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:24.119379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:24.119423 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:24.119385    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:24.119928 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:24.119577    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:24.120234 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:24.120154    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:25.118273 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:25.118238    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:25.118457 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:25.118365    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:26.117820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:26.117786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:26.118310 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:26.117800    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:26.118310 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:26.117916    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:26.118310 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:26.118016    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:27.117601 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:27.117561    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:27.117826 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.117684    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:27.748763 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:27.748728    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:27.749251 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:27.748777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:27.749251 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.748915    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:27.749251 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.748942    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:27.749251 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.749017    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.748978331 +0000 UTC m=+34.164163402 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:27.749251 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.749039    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.749028459 +0000 UTC m=+34.164213516 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:27.950084 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:27.950052    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:27.950241 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.950206    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:27.950241 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.950223    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:27.950241 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.950234    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:27.950367 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:27.950295    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:43.95027774 +0000 UTC m=+34.365462796 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:28.117453 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:28.117379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:28.117604 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:28.117492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:28.117604 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:28.117535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:28.117604 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:28.117589    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:29.118007 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:29.117958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:29.118406 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:29.118101    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:30.118795 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:30.118755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:30.119191 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:30.118856    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:30.119191 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:30.118914    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:30.119191 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:30.119028    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:31.117494 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:31.117457    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:31.117673 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:31.117593    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:32.117480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:32.117441    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:32.117480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:32.117470    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:32.118175 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:32.117595    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:32.118175 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:32.117739    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:33.118748 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.118724    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:33.120098 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:33.118838    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:33.265736 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.265586    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nbmwb" event={"ID":"0c2f8c91-5a09-4c97-9446-0ca58af796b7","Type":"ContainerStarted","Data":"dcaf012bdb9c1f67d6a04bc396eb3e3b9c193badee885a1ef860b56c4530306f"}
Jul 09 14:55:33.267676 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.267643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-klqhj" event={"ID":"0985c491-382a-4c3a-940c-7e1e3d6b0925","Type":"ContainerStarted","Data":"96f0d08f290b03d158fd1d0ff15b96636b0cb73db55cdb5b549ea3b86cbbdf4f"}
Jul 09 14:55:33.271376 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.271341    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc" event={"ID":"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd","Type":"ContainerStarted","Data":"97315b04f70ab270a851e9cfa6413c93f8dff8f2a16690985047023f8eeb1f27"}
Jul 09 14:55:33.273056 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.273019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hbxb5" event={"ID":"ed9a78e5-6aab-4010-8d11-2e653d030f2c","Type":"ContainerStarted","Data":"d3b80ea1a475796d9a2f129a9bf191f625ab7ab51380e692376bd86971b36ad5"}
Jul 09 14:55:33.274798 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.274748    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2ljtt" event={"ID":"94224c1b-197b-4e14-9585-802eebd128c6","Type":"ContainerStarted","Data":"1edcf6a1dc59cc7c57c5e466544e66d581dc437328dc4d3b01a1e2cd0b8a55f2"}
Jul 09 14:55:33.278479 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.278349    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"c233679e6f201d42853f3087c0e3b1522b504f9ef1661789d0dd2dbb10218f01"}
Jul 09 14:55:33.278479 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.278418    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"f51284ec6693a4064c0a849f86ff62f97fd98a99131eb168f6100ef0841613bf"}
Jul 09 14:55:33.281521 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.281483    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerStarted","Data":"cc58336ddf2631cdff1dac294fd183a2699fa876607d8a1c0dccc3975022d091"}
Jul 09 14:55:33.287881 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.287429    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nbmwb" podStartSLOduration=2.74400896 podStartE2EDuration="22.287415707s" totalImagesPullingTime="19.543406747s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:33.287234866 +0000 UTC m=+23.702419943" watchObservedRunningTime="2026-07-09 14:55:33.287415707 +0000 UTC m=+23.702600784"
Jul 09 14:55:33.287881 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.287632    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-129-1.ec2.internal" podStartSLOduration=22.287627235 podStartE2EDuration="22.287627235s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:15.234202618 +0000 UTC m=+5.649387701" watchObservedRunningTime="2026-07-09 14:55:33.287627235 +0000 UTC m=+23.702812312"
Jul 09 14:55:33.288947 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.288920    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-fzfxb" event={"ID":"f633027c-66fd-4326-9488-ef6da09462bd","Type":"ContainerStarted","Data":"ae8749c50ca633a1b1ae9782d0af58d72a4db0dc3620bda393e60ef233c99273"}
Jul 09 14:55:33.307118 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.307075    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-klqhj" podStartSLOduration=2.726548524 podStartE2EDuration="22.307059324s" totalImagesPullingTime="19.5805108s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:33.306690889 +0000 UTC m=+23.721875966" watchObservedRunningTime="2026-07-09 14:55:33.307059324 +0000 UTC m=+23.722244400"
Jul 09 14:55:33.324876 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.324803    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hbxb5" podStartSLOduration=3.771782622 podStartE2EDuration="23.324787971s" totalImagesPullingTime="19.553005349s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:33.32444003 +0000 UTC m=+23.739625106" watchObservedRunningTime="2026-07-09 14:55:33.324787971 +0000 UTC m=+23.739973047"
Jul 09 14:55:33.345954 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.345895    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2ljtt" podStartSLOduration=10.852424756 podStartE2EDuration="22.345874318s" totalImagesPullingTime="11.493449562s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:33.34529268 +0000 UTC m=+23.760477758" watchObservedRunningTime="2026-07-09 14:55:33.345874318 +0000 UTC m=+23.761059395"
Jul 09 14:55:33.462783 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.462751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:33.543912 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:33.543882    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:34.117891 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.117854    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:34.118112 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:34.118005    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:34.118112 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.118045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:34.118213 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:34.118136    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:34.294189 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.294156    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"d77cc899fe9d59deb3715f86b78e42ef992c4e8fe1e3b2927e53e70ba20acbc5"}
Jul 09 14:55:34.294885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.294234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"64d1b5aa5c71903f32fd0211a19b5b7ab42f441ee24b2dba9431b8c1026a9e5f"}
Jul 09 14:55:34.294885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.294277    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"aced8af57d3535b2fa5978e824c2151374305b674895bc7a268a330a1ac5a36a"}
Jul 09 14:55:34.294885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.294306    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"79fd45888084f484eb95dd20b5451dd0978b6e359edd79898be84d8822301a55"}
Jul 09 14:55:34.295622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.295599    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="cc58336ddf2631cdff1dac294fd183a2699fa876607d8a1c0dccc3975022d091" exitCode=0
Jul 09 14:55:34.295712 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.295686    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"cc58336ddf2631cdff1dac294fd183a2699fa876607d8a1c0dccc3975022d091"}
Jul 09 14:55:34.789711 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:34.789683    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 09 14:55:35.055560 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.055445    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T14:55:34.789705527Z","UUID":"70fd5312-64ae-4215-ae41-72485fef7fe5","Handler":null,"Name":"","Endpoint":""}
Jul 09 14:55:35.058102 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.058067    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 09 14:55:35.058102 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.058107    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 09 14:55:35.118035 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.118005    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:35.118210 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:35.118101    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:35.299423 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.299385    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jbr54" event={"ID":"febb7629-0e56-4277-83ff-d004589a462e","Type":"ContainerStarted","Data":"248b88101ae3526830e877b72458efbe951016e21148d400dfc803fbdfac5ff0"}
Jul 09 14:55:35.301424 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.301390    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc" event={"ID":"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd","Type":"ContainerStarted","Data":"5fdc3016b37dedc09b70a3ce6d79aac48b5bf32b2a17e0b0aef37a4faaf5f613"}
Jul 09 14:55:35.317933 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.317856    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jbr54" podStartSLOduration=4.78144042 podStartE2EDuration="24.317842546s" totalImagesPullingTime="19.536402126s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:35.317806573 +0000 UTC m=+25.732991653" watchObservedRunningTime="2026-07-09 14:55:35.317842546 +0000 UTC m=+25.733027623"
Jul 09 14:55:35.318054 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.318032    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-fzfxb" podStartSLOduration=4.758892805 podStartE2EDuration="24.318027733s" totalImagesPullingTime="19.559134928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:33.390548144 +0000 UTC m=+23.805733217" watchObservedRunningTime="2026-07-09 14:55:35.318027733 +0000 UTC m=+25.733212809"
Jul 09 14:55:35.443208 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.443172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:35.514325 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:35.514280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:36.085575 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.085542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:36.086176 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.086154    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:36.117922 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.117893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:36.118101 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:36.118031    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:36.118101 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.118089    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:36.118223 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:36.118203    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:36.306918 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.306877    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"d7e46eb6367f909a0b7be18941ced4f19ce5902ab43101528ec5635529fd915e"}
Jul 09 14:55:36.308885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.308850    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc" event={"ID":"7ca606c5-aeb0-46b7-b7fb-d96acf2171cd","Type":"ContainerStarted","Data":"f9e0600485a17b8628edf891257dd0282019c50056f3be60342d989576718e00"}
Jul 09 14:55:36.309277 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.309244    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:36.309583 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.309568    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2ljtt"
Jul 09 14:55:36.332123 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.332086    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2nlrc" podStartSLOduration=10.999480858 podStartE2EDuration="25.332072648s" totalImagesPullingTime="14.33259179s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:36.331571495 +0000 UTC m=+26.746756570" watchObservedRunningTime="2026-07-09 14:55:36.332072648 +0000 UTC m=+26.747257724"
Jul 09 14:55:36.404724 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:36.404678    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:37.046958 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:37.046708    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:37.109985 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:37.109948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:37.117983 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:37.117966    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:37.118101 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:37.118081    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:38.117962 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:38.117880    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:38.118523 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:38.118042    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:38.118523 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:38.118059    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:38.118523 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:38.118171    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:39.117404 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:39.117370    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:39.117599 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:39.117508    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:40.118716 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.118498    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:40.119287 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.118569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:40.119287 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:40.118754    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:40.119287 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:40.118826    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:40.324565 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.324524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" event={"ID":"56ddfb46-e191-4664-bbcf-901f93b5b7cf","Type":"ContainerStarted","Data":"b7dde3a5e2539c169ad16e5f4255030484172fd3569489e1de796b1887227558"}
Jul 09 14:55:40.324794 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.324758    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:40.324930 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.324836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:40.326413 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.326376    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="21ff5bb2591f071e5ec48940ec53e70e482cdd6e345e6550b55e88607a34ca6b" exitCode=0
Jul 09 14:55:40.326524 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.326417    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"21ff5bb2591f071e5ec48940ec53e70e482cdd6e345e6550b55e88607a34ca6b"}
Jul 09 14:55:40.341094 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.341072    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:40.355259 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:40.355220    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb" podStartSLOduration=9.731628319 podStartE2EDuration="29.355207805s" totalImagesPullingTime="19.623579486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:40.355114962 +0000 UTC m=+30.770300037" watchObservedRunningTime="2026-07-09 14:55:40.355207805 +0000 UTC m=+30.770392915"
Jul 09 14:55:41.117727 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.117701    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:41.117882 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:41.117794    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:41.329438 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.329411    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:41.346425 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.346397    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:55:41.621785 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.621746    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.715808 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.715774    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.818196 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.817976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:41.919815 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.919739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6swk"]
Jul 09 14:55:41.920012 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.919899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:41.920082 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:41.920049    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:41.922092 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.922066    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqb5z"]
Jul 09 14:55:41.922231 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.922196    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:41.922329 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:41.922306    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:41.922670 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.922649    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76ps4"]
Jul 09 14:55:41.922757 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:41.922744    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:41.922852 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:41.922834    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:42.333405 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:42.333377    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="e6689bb81b7bcde1188bac3b8330330f91658dbd714a577f8ce710629902c08b" exitCode=0
Jul 09 14:55:42.333812 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:42.333443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"e6689bb81b7bcde1188bac3b8330330f91658dbd714a577f8ce710629902c08b"}
Jul 09 14:55:42.606464 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:42.606383    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:42.672154 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:42.672120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:43.118706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.118351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:43.118706 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.118486    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:43.337784 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.337753    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="acd74033beeb0b0d9a3d3a9aaa09c20005bb19324e1258e133142e3e16a5d00b" exitCode=0
Jul 09 14:55:43.338235 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.337839    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"acd74033beeb0b0d9a3d3a9aaa09c20005bb19324e1258e133142e3e16a5d00b"}
Jul 09 14:55:43.762918 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.762886    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:43.763080 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.762924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:43.763080 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.763023    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:43.763080 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.763029    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:43.763080 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.763068    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:15.763056078 +0000 UTC m=+66.178241131 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 09 14:55:43.763080 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.763080    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret podName:d38b4155-289f-46f0-944a-35d04d5e9631 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:15.763074462 +0000 UTC m=+66.178259515 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret") pod "global-pull-secret-syncer-k6swk" (UID: "d38b4155-289f-46f0-944a-35d04d5e9631") : object "kube-system"/"original-pull-secret" not registered
Jul 09 14:55:43.963885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:43.963856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:43.964051 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.964025    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 09 14:55:43.964051 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.964043    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 09 14:55:43.964051 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.964053    2578 projected.go:196] Error preparing data for projected volume kube-api-access-94ttp for pod openshift-network-diagnostics/network-check-target-76ps4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:43.964174 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:43.964101    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp podName:e9d8bab3-6673-4914-9633-63fc43b72702 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:15.964086932 +0000 UTC m=+66.379271986 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-94ttp" (UniqueName: "kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp") pod "network-check-target-76ps4" (UID: "e9d8bab3-6673-4914-9633-63fc43b72702") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 09 14:55:44.118069 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:44.118037    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:44.118238 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:44.118176    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:44.118238 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:44.118230    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:44.118377 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:44.118355    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:45.117910 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:45.117873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:45.118541 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:45.118013    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-76ps4" podUID="e9d8bab3-6673-4914-9633-63fc43b72702"
Jul 09 14:55:46.118119 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.118085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:46.118516 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:46.118213    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-k6swk" podUID="d38b4155-289f-46f0-944a-35d04d5e9631"
Jul 09 14:55:46.118516 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.118085    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:46.118641 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:46.118619    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-cqb5z" podUID="7c5f32c8-bc79-41a4-b1dd-e0c38d795891"
Jul 09 14:55:46.562325 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.562289    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:46.909220 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.909146    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-129-1.ec2.internal" event="NodeReady"
Jul 09 14:55:46.909369 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.909303    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 09 14:55:46.965280 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.965251    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5c747"]
Jul 09 14:55:46.968567 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.968543    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:46.969379 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.969357    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rvjs9"]
Jul 09 14:55:46.971478 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.971455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 09 14:55:46.971607 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.971524    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:46.971698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.971677    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 09 14:55:46.972157 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.972132    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rns85\""
Jul 09 14:55:46.974514 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.974494    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 09 14:55:46.974745 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.974725    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 09 14:55:46.974809 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.974760    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pfsrh\""
Jul 09 14:55:46.975039 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.975020    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 09 14:55:46.983067 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.983046    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5c747"]
Jul 09 14:55:46.987190 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:46.987167    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvjs9"]
Jul 09 14:55:47.092563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.090038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67f283a-3d39-4c54-9e36-aa5446a36d43-tmp-dir\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.092563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.092457    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354196a-c26a-46f1-ac17-56565debaa7f-cert\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.093123 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.093094    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.093257 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.093141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wcx54\" (UniqueName: \"kubernetes.io/projected/f354196a-c26a-46f1-ac17-56565debaa7f-kube-api-access-wcx54\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.093257 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.093171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsmrq\" (UniqueName: \"kubernetes.io/projected/f67f283a-3d39-4c54-9e36-aa5446a36d43-kube-api-access-hsmrq\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.093330 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.093287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f67f283a-3d39-4c54-9e36-aa5446a36d43-config-volume\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.117560 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.117528    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:55:47.120852 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.120832    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:55:47.121299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.120916    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:55:47.121299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.121249    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h92\""
Jul 09 14:55:47.172539 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.172457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:47.194237 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194209    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.194401 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wcx54\" (UniqueName: \"kubernetes.io/projected/f354196a-c26a-46f1-ac17-56565debaa7f-kube-api-access-wcx54\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.194401 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsmrq\" (UniqueName: \"kubernetes.io/projected/f67f283a-3d39-4c54-9e36-aa5446a36d43-kube-api-access-hsmrq\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.194401 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f67f283a-3d39-4c54-9e36-aa5446a36d43-config-volume\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.194401 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194366    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67f283a-3d39-4c54-9e36-aa5446a36d43-tmp-dir\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.194401 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:47.194371    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:47.194697 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:47.194433    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:47.694412835 +0000 UTC m=+38.109597893 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:47.194697 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354196a-c26a-46f1-ac17-56565debaa7f-cert\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.194697 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.194680    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f67f283a-3d39-4c54-9e36-aa5446a36d43-tmp-dir\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.195061 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.195042    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f67f283a-3d39-4c54-9e36-aa5446a36d43-config-volume\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.199363 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.199325    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f354196a-c26a-46f1-ac17-56565debaa7f-cert\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.206415 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.206390    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsmrq\" (UniqueName: \"kubernetes.io/projected/f67f283a-3d39-4c54-9e36-aa5446a36d43-kube-api-access-hsmrq\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.207820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.207799    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wcx54\" (UniqueName: \"kubernetes.io/projected/f354196a-c26a-46f1-ac17-56565debaa7f-kube-api-access-wcx54\") pod \"ingress-canary-rvjs9\" (UID: \"f354196a-c26a-46f1-ac17-56565debaa7f\") " pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.274625 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.274583    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:47.288481 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.288455    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rvjs9"
Jul 09 14:55:47.699894 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.699846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:47.700101 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:47.700068    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:47.700157 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:47.700146    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:48.700124887 +0000 UTC m=+39.115309945 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:47.952661 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:47.952450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rvjs9"]
Jul 09 14:55:47.955859 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:55:47.955826    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf354196a_c26a_46f1_ac17_56565debaa7f.slice/crio-db3397855bb578a570847fd9cd40d531e20052d41c0a7675f307c03183d14bb9 WatchSource:0}: Error finding container db3397855bb578a570847fd9cd40d531e20052d41c0a7675f307c03183d14bb9: Status 404 returned error can't find the container with id db3397855bb578a570847fd9cd40d531e20052d41c0a7675f307c03183d14bb9
Jul 09 14:55:48.117849 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.117822    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:55:48.118073 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.118051    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:55:48.123493 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.123471    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:55:48.123851 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.123476    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:55:48.123851 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.123481    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zbh8\""
Jul 09 14:55:48.352490 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.352409    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="13fa8c0b875202d6898cef90d14ac1b129a3c6a36bad9c412855a4a7f934ea20" exitCode=0
Jul 09 14:55:48.352657 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.352486    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"13fa8c0b875202d6898cef90d14ac1b129a3c6a36bad9c412855a4a7f934ea20"}
Jul 09 14:55:48.353690 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.353662    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvjs9" event={"ID":"f354196a-c26a-46f1-ac17-56565debaa7f","Type":"ContainerStarted","Data":"db3397855bb578a570847fd9cd40d531e20052d41c0a7675f307c03183d14bb9"}
Jul 09 14:55:48.710773 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:48.710648    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:48.710954 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:48.710774    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:48.710954 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:48.710842    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:50.710823684 +0000 UTC m=+41.126008738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:49.362466 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:49.362431    2578 generic.go:356] "Generic (PLEG): container finished" podID="62a37548-2d95-46fe-972c-f7acfc48359e" containerID="0117de46c015f41d6331152e6f9ad6f5f468420bc4163d3901956a2f0acbcf47" exitCode=0
Jul 09 14:55:49.362864 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:49.362506    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerDied","Data":"0117de46c015f41d6331152e6f9ad6f5f468420bc4163d3901956a2f0acbcf47"}
Jul 09 14:55:50.369522 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:50.369314    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" event={"ID":"62a37548-2d95-46fe-972c-f7acfc48359e","Type":"ContainerStarted","Data":"530af50ef66793c123cf7d104b96b5ec85f8ffb7abb3402622d33a1964ff604e"}
Jul 09 14:55:50.397377 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:50.397310    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-vjtwq" podStartSLOduration=6.758491335 podStartE2EDuration="39.397289053s" totalImagesPullingTime="32.638797718s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:50.394937864 +0000 UTC m=+40.810122965" watchObservedRunningTime="2026-07-09 14:55:50.397289053 +0000 UTC m=+40.812474130"
Jul 09 14:55:50.522737 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:50.522705    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:50.620509 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:50.620417    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:50.727228 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:50.727192    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:50.727393 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:50.727354    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:50.727468 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:50.727429    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:55:54.727407274 +0000 UTC m=+45.142592328 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:51.373157 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:51.373117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rvjs9" event={"ID":"f354196a-c26a-46f1-ac17-56565debaa7f","Type":"ContainerStarted","Data":"38dfaf0bb3a91831cd838d140eca4006c26ef0d7728744c4f355257be3685720"}
Jul 09 14:55:51.392984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:51.392934    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rvjs9" podStartSLOduration=2.5725576500000003 podStartE2EDuration="5.392919756s" totalImagesPullingTime="2.820362106s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:55:51.391773442 +0000 UTC m=+41.806958517" watchObservedRunningTime="2026-07-09 14:55:51.392919756 +0000 UTC m=+41.808104831"
Jul 09 14:55:51.787878 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:51.787840    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:51.848441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:51.848409    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.747108 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:54.747065    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:54.756885 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:54.756859    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:55:54.757042 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:54.756981    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:55:54.757101 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:55:54.757071    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:02.757052842 +0000 UTC m=+53.172237896 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:55:54.847928 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:54.847897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:55:59.022575 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:55:59.022527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:00.711528 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:00.711491    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:00.785822 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:00.785790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:02.812831 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:02.812791    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:56:02.813363 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:02.812943    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:02.813363 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:02.813028    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:18.813009069 +0000 UTC m=+69.228194136 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:11.187352 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:11.187314    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:12.703815 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:12.703777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:13.348789 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:13.348759    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fx4gb"
Jul 09 14:56:13.517039 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:13.516984    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:13.616708 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:13.616619    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:15.797477 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.797423    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:56:15.797477 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.797481    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:56:15.801243 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.801221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 09 14:56:15.801498 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.801484    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 09 14:56:15.807833 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:15.807815    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 09 14:56:15.807875 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:15.807868    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs podName:7c5f32c8-bc79-41a4-b1dd-e0c38d795891 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:19.807854232 +0000 UTC m=+130.223039285 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs") pod "network-metrics-daemon-cqb5z" (UID: "7c5f32c8-bc79-41a4-b1dd-e0c38d795891") : secret "metrics-daemon-secret" not found
Jul 09 14:56:15.811603 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.811583    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/d38b4155-289f-46f0-944a-35d04d5e9631-original-pull-secret\") pod \"global-pull-secret-syncer-k6swk\" (UID: \"d38b4155-289f-46f0-944a-35d04d5e9631\") " pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:56:15.998131 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:15.998082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:56:16.001415 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.001397    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 09 14:56:16.014526 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.014507    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 09 14:56:16.021080 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.021052    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-94ttp\" (UniqueName: \"kubernetes.io/projected/e9d8bab3-6673-4914-9633-63fc43b72702-kube-api-access-94ttp\") pod \"network-check-target-76ps4\" (UID: \"e9d8bab3-6673-4914-9633-63fc43b72702\") " pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:56:16.033238 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.033219    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-k6swk"
Jul 09 14:56:16.159013 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.158964    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-k6swk"]
Jul 09 14:56:16.230962 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.230941    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-c5h92\""
Jul 09 14:56:16.238467 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.238449    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:56:16.372255 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.372189    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-76ps4"]
Jul 09 14:56:16.375186 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:16.375166    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9d8bab3_6673_4914_9633_63fc43b72702.slice/crio-df3ed05bd401ea834ce8e2aa4a4cab9571339a26daed180951d27d61dc9be11b WatchSource:0}: Error finding container df3ed05bd401ea834ce8e2aa4a4cab9571339a26daed180951d27d61dc9be11b: Status 404 returned error can't find the container with id df3ed05bd401ea834ce8e2aa4a4cab9571339a26daed180951d27d61dc9be11b
Jul 09 14:56:16.430538 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.430498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76ps4" event={"ID":"e9d8bab3-6673-4914-9633-63fc43b72702","Type":"ContainerStarted","Data":"df3ed05bd401ea834ce8e2aa4a4cab9571339a26daed180951d27d61dc9be11b"}
Jul 09 14:56:16.431639 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:16.431617    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6swk" event={"ID":"d38b4155-289f-46f0-944a-35d04d5e9631","Type":"ContainerStarted","Data":"45b94e20fe7fac594ef2be4d3fbbf49124fd079d496296de08ea2df902f06c4a"}
Jul 09 14:56:18.821951 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:18.821915    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:56:18.822321 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:18.822087    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:18.822321 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:18.822189    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:50.822171346 +0000 UTC m=+101.237356401 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:20.668158 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:20.668105    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:20.731402 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:20.731365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:20.811458 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:20.811396    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:21.446806 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:21.446704    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-76ps4" event={"ID":"e9d8bab3-6673-4914-9633-63fc43b72702","Type":"ContainerStarted","Data":"aa17bfcf8e9aea92c9db7d0fbc69e1dbf9d32606bda2189152614ce607034099"}
Jul 09 14:56:21.447009 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:21.446835    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:56:21.448233 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:21.448192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-k6swk" event={"ID":"d38b4155-289f-46f0-944a-35d04d5e9631","Type":"ContainerStarted","Data":"86f1fbcf1fc86c210781bb4594f7a68cb4bc169fd1392a5778e8c299d60ebd8d"}
Jul 09 14:56:21.466891 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:21.466851    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-76ps4" podStartSLOduration=65.659083426 podStartE2EDuration="1m10.466839729s" totalImagesPullingTime="4.807756303s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:21.465598759 +0000 UTC m=+71.880783837" watchObservedRunningTime="2026-07-09 14:56:21.466839729 +0000 UTC m=+71.882024804"
Jul 09 14:56:24.326719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:24.326667    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:50.828518 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:50.828398    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:56:50.829066 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:50.828537    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 09 14:56:50.829066 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:50.828590    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls podName:f67f283a-3d39-4c54-9e36-aa5446a36d43 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:54.828575902 +0000 UTC m=+165.243760956 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls") pod "dns-default-5c747" (UID: "f67f283a-3d39-4c54-9e36-aa5446a36d43") : secret "dns-default-metrics-tls" not found
Jul 09 14:56:51.210108 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.210048    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-k6swk" podStartSLOduration=95.188349668 podStartE2EDuration="1m40.210028087s" totalImagesPullingTime="5.021678419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:55:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:21.51553278 +0000 UTC m=+71.930717855" watchObservedRunningTime="2026-07-09 14:56:51.210028087 +0000 UTC m=+101.625213164"
Jul 09 14:56:51.210591 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.210569    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"]
Jul 09 14:56:51.243874 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.243848    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"]
Jul 09 14:56:51.244006 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.243956    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.247984 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.247965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 09 14:56:51.248220 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.248204    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6m5w2\""
Jul 09 14:56:51.248357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.248339    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 09 14:56:51.249248 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.249212    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 09 14:56:51.250707 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.250691    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 09 14:56:51.279778 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.279752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:51.320188 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.320165    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-pmmtx"]
Jul 09 14:56:51.332083 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.332051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqkkc\" (UniqueName: \"kubernetes.io/projected/1e2df791-0ddf-41d0-a89e-800064af51fd-kube-api-access-kqkkc\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.332175 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.332102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.332226 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.332208    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e2df791-0ddf-41d0-a89e-800064af51fd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.341514 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.341494    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"]
Jul 09 14:56:51.341653 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.341628    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.344475 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.344452    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-4qlwf\""
Jul 09 14:56:51.344925 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.344907    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 09 14:56:51.345219 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.344913    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:56:51.345219 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.345131    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 09 14:56:51.345219 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.345139    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 09 14:56:51.351376 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.351358    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 09 14:56:51.353479 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.353461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"]
Jul 09 14:56:51.353551 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.353494    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-pmmtx"]
Jul 09 14:56:51.353591 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.353562    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.356634 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.356619    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 09 14:56:51.356920 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.356900    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 09 14:56:51.357021 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.356903    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-2njtp\""
Jul 09 14:56:51.357135 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.357121    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:56:51.358571 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.358553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 09 14:56:51.378540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.378521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:51.409723 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.409701    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"]
Jul 09 14:56:51.431596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.431575    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"]
Jul 09 14:56:51.431679 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.431646    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.432582 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432560    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.432664 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790cd51-fa0c-45f5-8c68-3a04310bb53d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.432736 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:51.432696    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:51.432736 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-config\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.432841 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:51.432742    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:56:51.932725484 +0000 UTC m=+102.347910539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:51.432841 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e2df791-0ddf-41d0-a89e-800064af51fd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.432841 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlhtp\" (UniqueName: \"kubernetes.io/projected/8790cd51-fa0c-45f5-8c68-3a04310bb53d-kube-api-access-nlhtp\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.433010 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432854    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c290e4a-1ef9-497e-8cd6-508247c38320-serving-cert\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.433010 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbjgq\" (UniqueName: \"kubernetes.io/projected/6c290e4a-1ef9-497e-8cd6-508247c38320-kube-api-access-cbjgq\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.433010 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqkkc\" (UniqueName: \"kubernetes.io/projected/1e2df791-0ddf-41d0-a89e-800064af51fd-kube-api-access-kqkkc\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.433010 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432946    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-trusted-ca\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.433010 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.432973    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790cd51-fa0c-45f5-8c68-3a04310bb53d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.433448 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.433425    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1e2df791-0ddf-41d0-a89e-800064af51fd-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.434795 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.434774    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-72zwq\""
Jul 09 14:56:51.434919 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.434805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 09 14:56:51.434919 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.434844    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 09 14:56:51.434919 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.434806    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 09 14:56:51.435151 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.435136    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 09 14:56:51.441564 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.441547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqkkc\" (UniqueName: \"kubernetes.io/projected/1e2df791-0ddf-41d0-a89e-800064af51fd-kube-api-access-kqkkc\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.533948 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.533877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlhtp\" (UniqueName: \"kubernetes.io/projected/8790cd51-fa0c-45f5-8c68-3a04310bb53d-kube-api-access-nlhtp\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.533948 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.533906    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c290e4a-1ef9-497e-8cd6-508247c38320-serving-cert\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.533948 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.533932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbjgq\" (UniqueName: \"kubernetes.io/projected/6c290e4a-1ef9-497e-8cd6-508247c38320-kube-api-access-cbjgq\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.534172 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.533960    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-trusted-ca\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.534172 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534007    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-config\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.534172 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534034    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790cd51-fa0c-45f5-8c68-3a04310bb53d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.534172 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc958\" (UniqueName: \"kubernetes.io/projected/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-kube-api-access-gc958\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.534293 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534211    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790cd51-fa0c-45f5-8c68-3a04310bb53d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.534293 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534256    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-config\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.534293 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534274    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.534932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-config\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.534932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.534920    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/8790cd51-fa0c-45f5-8c68-3a04310bb53d-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.535234 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.535217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/6c290e4a-1ef9-497e-8cd6-508247c38320-trusted-ca\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.536435 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.536408    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/6c290e4a-1ef9-497e-8cd6-508247c38320-serving-cert\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.536564 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.536547    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/8790cd51-fa0c-45f5-8c68-3a04310bb53d-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.543445 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.543420    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlhtp\" (UniqueName: \"kubernetes.io/projected/8790cd51-fa0c-45f5-8c68-3a04310bb53d-kube-api-access-nlhtp\") pod \"kube-storage-version-migrator-operator-799cb7f958-l6cnd\" (UID: \"8790cd51-fa0c-45f5-8c68-3a04310bb53d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.543709 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.543688    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbjgq\" (UniqueName: \"kubernetes.io/projected/6c290e4a-1ef9-497e-8cd6-508247c38320-kube-api-access-cbjgq\") pod \"console-operator-7866497494-pmmtx\" (UID: \"6c290e4a-1ef9-497e-8cd6-508247c38320\") " pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.635215 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.635191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.635314 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.635240    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-config\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.635314 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.635260    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc958\" (UniqueName: \"kubernetes.io/projected/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-kube-api-access-gc958\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.635695 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.635677    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-config\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.637297 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.637277    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-serving-cert\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.646092 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.646073    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc958\" (UniqueName: \"kubernetes.io/projected/f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6-kube-api-access-gc958\") pod \"service-ca-operator-7695fc6c8c-82zmw\" (UID: \"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.653011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.652978    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:56:51.661123 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.661107    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"
Jul 09 14:56:51.740568 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.740341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"
Jul 09 14:56:51.817370 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.817316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-pmmtx"]
Jul 09 14:56:51.820663 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:51.820635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c290e4a_1ef9_497e_8cd6_508247c38320.slice/crio-02385c18f9f5d303ad34420d3bf718764441f8ed7c2ba6fed63750b3027066ff WatchSource:0}: Error finding container 02385c18f9f5d303ad34420d3bf718764441f8ed7c2ba6fed63750b3027066ff: Status 404 returned error can't find the container with id 02385c18f9f5d303ad34420d3bf718764441f8ed7c2ba6fed63750b3027066ff
Jul 09 14:56:51.829341 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.829318    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd"]
Jul 09 14:56:51.832005 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:51.831965    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8790cd51_fa0c_45f5_8c68_3a04310bb53d.slice/crio-13f1ca552407083a69b9ef0688d82e5d7d05f0330cbd5db6b17013febeca69ff WatchSource:0}: Error finding container 13f1ca552407083a69b9ef0688d82e5d7d05f0330cbd5db6b17013febeca69ff: Status 404 returned error can't find the container with id 13f1ca552407083a69b9ef0688d82e5d7d05f0330cbd5db6b17013febeca69ff
Jul 09 14:56:51.892416 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.892389    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw"]
Jul 09 14:56:51.895085 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:51.895050    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf68e25cb_d03a_4ea3_a825_c56cdd3ec7c6.slice/crio-efcffeefb93632c18fdfaea279cdb1620b280ece646f197b29e85fd7ac60d60c WatchSource:0}: Error finding container efcffeefb93632c18fdfaea279cdb1620b280ece646f197b29e85fd7ac60d60c: Status 404 returned error can't find the container with id efcffeefb93632c18fdfaea279cdb1620b280ece646f197b29e85fd7ac60d60c
Jul 09 14:56:51.937945 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:51.937918    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:51.938114 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:51.938096    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:51.938183 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:51.938167    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:56:52.938147787 +0000 UTC m=+103.353332842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:52.077812 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.077745    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"]
Jul 09 14:56:52.112305 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.112282    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"]
Jul 09 14:56:52.112429 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.112390    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"
Jul 09 14:56:52.115591 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.115568    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-5r9w6\""
Jul 09 14:56:52.241193 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.241166    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8sv6\" (UniqueName: \"kubernetes.io/projected/bf341047-2a97-48fd-b4d8-928811b259e0-kube-api-access-h8sv6\") pod \"network-check-source-869dcfcdcd-bv46x\" (UID: \"bf341047-2a97-48fd-b4d8-928811b259e0\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"
Jul 09 14:56:52.341641 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.341576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8sv6\" (UniqueName: \"kubernetes.io/projected/bf341047-2a97-48fd-b4d8-928811b259e0-kube-api-access-h8sv6\") pod \"network-check-source-869dcfcdcd-bv46x\" (UID: \"bf341047-2a97-48fd-b4d8-928811b259e0\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"
Jul 09 14:56:52.351800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.351776    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8sv6\" (UniqueName: \"kubernetes.io/projected/bf341047-2a97-48fd-b4d8-928811b259e0-kube-api-access-h8sv6\") pod \"network-check-source-869dcfcdcd-bv46x\" (UID: \"bf341047-2a97-48fd-b4d8-928811b259e0\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"
Jul 09 14:56:52.420851 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.420825    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"
Jul 09 14:56:52.453715 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.453692    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-76ps4"
Jul 09 14:56:52.527963 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.527891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw" event={"ID":"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6","Type":"ContainerStarted","Data":"efcffeefb93632c18fdfaea279cdb1620b280ece646f197b29e85fd7ac60d60c"}
Jul 09 14:56:52.529441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.529415    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pmmtx" event={"ID":"6c290e4a-1ef9-497e-8cd6-508247c38320","Type":"ContainerStarted","Data":"02385c18f9f5d303ad34420d3bf718764441f8ed7c2ba6fed63750b3027066ff"}
Jul 09 14:56:52.531754 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.531278    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd" event={"ID":"8790cd51-fa0c-45f5-8c68-3a04310bb53d","Type":"ContainerStarted","Data":"13f1ca552407083a69b9ef0688d82e5d7d05f0330cbd5db6b17013febeca69ff"}
Jul 09 14:56:52.606792 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.605468    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x"]
Jul 09 14:56:52.612532 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:52.612500    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf341047_2a97_48fd_b4d8_928811b259e0.slice/crio-f348dcd16a380bc3f3713ecff0445795b95507e1a8286118f7d5384726b79cc2 WatchSource:0}: Error finding container f348dcd16a380bc3f3713ecff0445795b95507e1a8286118f7d5384726b79cc2: Status 404 returned error can't find the container with id f348dcd16a380bc3f3713ecff0445795b95507e1a8286118f7d5384726b79cc2
Jul 09 14:56:52.946855 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:52.946571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:52.946855 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:52.946705    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:52.946855 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:52.946776    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:56:54.946753461 +0000 UTC m=+105.361938530 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:53.535764 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:53.535636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x" event={"ID":"bf341047-2a97-48fd-b4d8-928811b259e0","Type":"ContainerStarted","Data":"cbe06b924421974077b7a314976ea5524fef193e299f8de6db30e09ba9b06d69"}
Jul 09 14:56:53.535764 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:53.535731    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x" event={"ID":"bf341047-2a97-48fd-b4d8-928811b259e0","Type":"ContainerStarted","Data":"f348dcd16a380bc3f3713ecff0445795b95507e1a8286118f7d5384726b79cc2"}
Jul 09 14:56:53.556212 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:53.556052    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-bv46x" podStartSLOduration=1.556031912 podStartE2EDuration="1.556031912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:53.554509363 +0000 UTC m=+103.969694440" watchObservedRunningTime="2026-07-09 14:56:53.556031912 +0000 UTC m=+103.971216990"
Jul 09 14:56:53.811513 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:53.811426    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:53.880479 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:53.880444    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:54.962426 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:54.962393    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:54.962911 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:54.962562    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:54.962911 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:54.962652    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:56:58.962628548 +0000 UTC m=+109.377813669 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:55.344635 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.344608    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-tvsqx"]
Jul 09 14:56:55.346865 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.346848    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.350286 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.350263    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 09 14:56:55.350559 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.350538    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 09 14:56:55.351584 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.351440    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 09 14:56:55.351584 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.351457    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 09 14:56:55.351584 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.351441    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cq4x2\""
Jul 09 14:56:55.371445 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.371404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvsqx"]
Jul 09 14:56:55.381544 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.381509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:55.466739 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.466705    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd011838-6e44-44ff-8f1e-d7c8acaed378-crio-socket\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.466880 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.466773    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd011838-6e44-44ff-8f1e-d7c8acaed378-data-volume\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.466880 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.466810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.467005 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.466886    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.467005 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.466915    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qt2gm\" (UniqueName: \"kubernetes.io/projected/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-api-access-qt2gm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.494268 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.494241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:55.543921 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.543864    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw" event={"ID":"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6","Type":"ContainerStarted","Data":"95039311a05d15a3efccc4fcc69d2ecddea867295265a2a49c6a23c3ec18d478"}
Jul 09 14:56:55.545618 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.545599    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/0.log"
Jul 09 14:56:55.545720 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.545638    2578 generic.go:356] "Generic (PLEG): container finished" podID="6c290e4a-1ef9-497e-8cd6-508247c38320" containerID="957cbd8e4e10bbee3bb4ffde2402b1d624dd4478cb9d8e22fa04f095e0d3bb4a" exitCode=255
Jul 09 14:56:55.545783 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.545721    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pmmtx" event={"ID":"6c290e4a-1ef9-497e-8cd6-508247c38320","Type":"ContainerDied","Data":"957cbd8e4e10bbee3bb4ffde2402b1d624dd4478cb9d8e22fa04f095e0d3bb4a"}
Jul 09 14:56:55.545880 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.545861    2578 scope.go:117] "RemoveContainer" containerID="957cbd8e4e10bbee3bb4ffde2402b1d624dd4478cb9d8e22fa04f095e0d3bb4a"
Jul 09 14:56:55.547350 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.547299    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd" event={"ID":"8790cd51-fa0c-45f5-8c68-3a04310bb53d","Type":"ContainerStarted","Data":"ce432dbf61dc706a36651724bc18d5d86ea671030a6f8760f9a592f95fb0fe87"}
Jul 09 14:56:55.565818 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.565774    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw" podStartSLOduration=1.186598727 podStartE2EDuration="4.565759529s" totalImagesPullingTime="3.379160802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:55.565332831 +0000 UTC m=+105.980517899" watchObservedRunningTime="2026-07-09 14:56:55.565759529 +0000 UTC m=+105.980944606"
Jul 09 14:56:55.567360 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd011838-6e44-44ff-8f1e-d7c8acaed378-crio-socket\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567485 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd011838-6e44-44ff-8f1e-d7c8acaed378-data-volume\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567485 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567407    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567485 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567449    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567485 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567461    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/bd011838-6e44-44ff-8f1e-d7c8acaed378-crio-socket\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567759 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.567499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qt2gm\" (UniqueName: \"kubernetes.io/projected/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-api-access-qt2gm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.567759 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:55.567543    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:55.567759 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:55.567592    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:56.067576115 +0000 UTC m=+106.482761169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:55.567759 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:55.567588    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:56:55.567759 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:55.567691    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:56.067674104 +0000 UTC m=+106.482859163 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : configmap "kube-rbac-proxy" not found
Jul 09 14:56:55.568039 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.568006    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/bd011838-6e44-44ff-8f1e-d7c8acaed378-data-volume\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.580813 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.580751    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qt2gm\" (UniqueName: \"kubernetes.io/projected/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-api-access-qt2gm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:55.585740 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:55.585699    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd" podStartSLOduration=1.14879013 podStartE2EDuration="4.585681454s" totalImagesPullingTime="3.436891324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:55.584514689 +0000 UTC m=+105.999699763" watchObservedRunningTime="2026-07-09 14:56:55.585681454 +0000 UTC m=+106.000866533"
Jul 09 14:56:56.072161 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.072129    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:56.072586 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.072226    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:56.072586 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:56.072286    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:56.072586 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:56.072296    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:56:56.072586 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:56.072352    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:57.072338666 +0000 UTC m=+107.487523720 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:56.072586 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:56.072367    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:57.072360859 +0000 UTC m=+107.487545913 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : configmap "kube-rbac-proxy" not found
Jul 09 14:56:56.553405 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.553381    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 14:56:56.553829 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.553812    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/0.log"
Jul 09 14:56:56.553916 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.553844    2578 generic.go:356] "Generic (PLEG): container finished" podID="6c290e4a-1ef9-497e-8cd6-508247c38320" containerID="a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6" exitCode=255
Jul 09 14:56:56.554150 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.554127    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pmmtx" event={"ID":"6c290e4a-1ef9-497e-8cd6-508247c38320","Type":"ContainerDied","Data":"a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6"}
Jul 09 14:56:56.554222 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.554183    2578 scope.go:117] "RemoveContainer" containerID="957cbd8e4e10bbee3bb4ffde2402b1d624dd4478cb9d8e22fa04f095e0d3bb4a"
Jul 09 14:56:56.554559 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.554535    2578 scope.go:117] "RemoveContainer" containerID="a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6"
Jul 09 14:56:56.554731 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:56.554709    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pmmtx_openshift-console-operator(6c290e4a-1ef9-497e-8cd6-508247c38320)\"" pod="openshift-console-operator/console-operator-7866497494-pmmtx" podUID="6c290e4a-1ef9-497e-8cd6-508247c38320"
Jul 09 14:56:56.727667 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.727635    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:56.744864 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.744838    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"]
Jul 09 14:56:56.747538 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.747520    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"
Jul 09 14:56:56.750472 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.750426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-bpp9f\""
Jul 09 14:56:56.750472 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.750448    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 09 14:56:56.750744 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.750729    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 09 14:56:56.760490 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.760470    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"]
Jul 09 14:56:56.823970 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.823896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:56.877154 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.877121    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwx52\" (UniqueName: \"kubernetes.io/projected/05e9f598-7b09-4fbf-9c95-89538b912e0a-kube-api-access-qwx52\") pod \"migrator-7f59b54f6c-lxxwm\" (UID: \"05e9f598-7b09-4fbf-9c95-89538b912e0a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"
Jul 09 14:56:56.919793 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.919766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:56.978158 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.978133    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwx52\" (UniqueName: \"kubernetes.io/projected/05e9f598-7b09-4fbf-9c95-89538b912e0a-kube-api-access-qwx52\") pod \"migrator-7f59b54f6c-lxxwm\" (UID: \"05e9f598-7b09-4fbf-9c95-89538b912e0a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"
Jul 09 14:56:56.986900 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:56.986872    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwx52\" (UniqueName: \"kubernetes.io/projected/05e9f598-7b09-4fbf-9c95-89538b912e0a-kube-api-access-qwx52\") pod \"migrator-7f59b54f6c-lxxwm\" (UID: \"05e9f598-7b09-4fbf-9c95-89538b912e0a\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"
Jul 09 14:56:57.022510 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.022479    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:57.057468 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.057431    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"
Jul 09 14:56:57.078625 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.078566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:57.078924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.078652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:57.078924 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:57.078688    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:56:57.078924 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:57.078752    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:59.078736321 +0000 UTC m=+109.493921377 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : configmap "kube-rbac-proxy" not found
Jul 09 14:56:57.078924 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:57.078780    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:57.078924 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:57.078840    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:56:59.0788249 +0000 UTC m=+109.494009955 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:57.122329 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.122297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:57.181947 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.181923    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm"]
Jul 09 14:56:57.185648 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:56:57.185624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e9f598_7b09_4fbf_9c95_89538b912e0a.slice/crio-09d85d0400a716c2d80ca437ac33b61afc9d16fdedb78804c1ee938cb2226575 WatchSource:0}: Error finding container 09d85d0400a716c2d80ca437ac33b61afc9d16fdedb78804c1ee938cb2226575: Status 404 returned error can't find the container with id 09d85d0400a716c2d80ca437ac33b61afc9d16fdedb78804c1ee938cb2226575
Jul 09 14:56:57.300263 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.300243    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hbxb5_ed9a78e5-6aab-4010-8d11-2e653d030f2c/dns-node-resolver/0.log"
Jul 09 14:56:57.558352 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.558319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm" event={"ID":"05e9f598-7b09-4fbf-9c95-89538b912e0a","Type":"ContainerStarted","Data":"09d85d0400a716c2d80ca437ac33b61afc9d16fdedb78804c1ee938cb2226575"}
Jul 09 14:56:57.563480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.563459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 14:56:57.563773 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.563755    2578 scope.go:117] "RemoveContainer" containerID="a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6"
Jul 09 14:56:57.563928 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:57.563908    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pmmtx_openshift-console-operator(6c290e4a-1ef9-497e-8cd6-508247c38320)\"" pod="openshift-console-operator/console-operator-7866497494-pmmtx" podUID="6c290e4a-1ef9-497e-8cd6-508247c38320"
Jul 09 14:56:57.689359 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.689327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:57.785655 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.785626    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:57.910221 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:57.910146    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzfxb_f633027c-66fd-4326-9488-ef6da09462bd/node-ca/0.log"
Jul 09 14:56:58.991343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:58.991315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:56:58.991699 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:58.991466    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:58.991699 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:58.991526    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:57:06.991510148 +0000 UTC m=+117.406695205 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:56:59.092612 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.092583    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:59.092724 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.092629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:56:59.092724 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:59.092702    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:56:59.092724 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:59.092720    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:59.092823 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:59.092759    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:03.092743907 +0000 UTC m=+113.507928960 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : configmap "kube-rbac-proxy" not found
Jul 09 14:56:59.092823 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:56:59.092772    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:03.092766213 +0000 UTC m=+113.507951266 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:56:59.105246 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.105199    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvjs9_f354196a-c26a-46f1-ac17-56565debaa7f/serve-healthcheck-canary/0.log"
Jul 09 14:56:59.332982 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.332908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:59.572060 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.572025    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm" event={"ID":"05e9f598-7b09-4fbf-9c95-89538b912e0a","Type":"ContainerStarted","Data":"4c2ebba00c465fdef03bc0b6429b93d2fa2cc7d72c0563d325a42b2b9a785b2f"}
Jul 09 14:56:59.572219 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.572075    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm" event={"ID":"05e9f598-7b09-4fbf-9c95-89538b912e0a","Type":"ContainerStarted","Data":"32f85f07754bdaed36eddaa1374912fc2b13c1bf670ab1c3dedb9a3b0fea651f"}
Jul 09 14:56:59.590615 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.590538    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lxxwm" podStartSLOduration=2.164984433 podStartE2EDuration="3.590525577s" totalImagesPullingTime="1.425541144s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:56:59.589916442 +0000 UTC m=+110.005101518" watchObservedRunningTime="2026-07-09 14:56:59.590525577 +0000 UTC m=+110.005710654"
Jul 09 14:56:59.690844 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.690797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:56:59.757862 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:56:59.757822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:00.421778 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:00.421747    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:01.653229 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:01.653197    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:57:01.653589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:01.653271    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:57:01.653589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:01.653567    2578 scope.go:117] "RemoveContainer" containerID="a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6"
Jul 09 14:57:01.653714 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:01.653695    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-pmmtx_openshift-console-operator(6c290e4a-1ef9-497e-8cd6-508247c38320)\"" pod="openshift-console-operator/console-operator-7866497494-pmmtx" podUID="6c290e4a-1ef9-497e-8cd6-508247c38320"
Jul 09 14:57:03.100954 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.100917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:03.123441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.123419    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:03.123526 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.123458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:03.123565 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:03.123537    2578 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 09 14:57:03.123565 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:03.123544    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:03.123636 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:03.123593    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.123580333 +0000 UTC m=+121.538765387 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:03.123636 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:03.123606    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:11.123599387 +0000 UTC m=+121.538784440 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : configmap "kube-rbac-proxy" not found
Jul 09 14:57:03.265828 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.265795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:03.361779 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.361700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:03.600666 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.600630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:03.805044 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:03.805015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:04.127235 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:04.127157    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:04.229216 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:04.229184    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:05.391534 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:05.391504    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:05.595958 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:05.595927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:05.787133 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:05.787101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:05.999305 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:05.999251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:06.098706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:06.098629    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:06.200911 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:06.200867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:06.982936 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:06.982896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.052119 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.052091    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:57:07.052273 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:07.052255    2578 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 09 14:57:07.052356 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:07.052344    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls podName:1e2df791-0ddf-41d0-a89e-800064af51fd nodeName:}" failed. No retries permitted until 2026-07-09 14:57:23.052323183 +0000 UTC m=+133.467508254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-cd665" (UID: "1e2df791-0ddf-41d0-a89e-800064af51fd") : secret "cluster-monitoring-operator-tls" not found
Jul 09 14:57:07.084000 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.083965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.195132 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.195101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.385964 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.385890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.486704 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.486670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.585506 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.585476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:07.988946 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:07.988915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:08.572619 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:08.572588    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:08.792389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:08.792352    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:09.204421 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:09.204385    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:09.389053 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:09.389025    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:09.491419 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:09.491340    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:09.593721 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:09.593687    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:09.807157 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:09.807086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:10.790082 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:10.790044    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:10.986571 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:10.986535    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:11.184187 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.184111    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:11.184187 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.184167    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:11.184347 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:11.184281    2578 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:11.184347 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:11.184337    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls podName:bd011838-6e44-44ff-8f1e-d7c8acaed378 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:27.184317938 +0000 UTC m=+137.599502992 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls") pod "insights-runtime-extractor-tvsqx" (UID: "bd011838-6e44-44ff-8f1e-d7c8acaed378") : secret "insights-runtime-extractor-tls" not found
Jul 09 14:57:11.184611 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.184591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/bd011838-6e44-44ff-8f1e-d7c8acaed378-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:11.385090 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.385057    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:11.589812 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.589753    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:11.661872 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:11.661841    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:12.203857 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:12.203824    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:12.305854 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:12.305827    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:12.404768 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:12.404744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:12.592353 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:12.592276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:12.993760 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:12.993723    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.118393 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.118368    2578 scope.go:117] "RemoveContainer" containerID="a162f1f0240ec1c7ca0b49fd9b35c2cfa2afac5debaec0c834cb8c2c373644f6"
Jul 09 14:57:13.385565 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.385476    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.586753 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.586719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.619535 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.619508    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 14:57:13.619647 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.619578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-pmmtx" event={"ID":"6c290e4a-1ef9-497e-8cd6-508247c38320","Type":"ContainerStarted","Data":"0f51a41c3739f97aa69cefcc3cce74de3afb616f1c29a349bdbe226cb161c26a"}
Jul 09 14:57:13.619908 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.619885    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:57:13.640365 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.640291    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-pmmtx" podStartSLOduration=19.189819166 podStartE2EDuration="22.640278792s" totalImagesPullingTime="3.450459626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:13.639379888 +0000 UTC m=+124.054564966" watchObservedRunningTime="2026-07-09 14:57:13.640278792 +0000 UTC m=+124.055463845"
Jul 09 14:57:13.784896 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.784856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:13.816493 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:13.816474    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-pmmtx"
Jul 09 14:57:14.049672 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.049634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.143840 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.143805    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.240923 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.240889    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.312168 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.312082    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.491931 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.491896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.593546 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.593475    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.712041 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.712016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.801985 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.801957    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:14.917809 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:14.917733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.109043 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:15.108977    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.178903 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:15.178837    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.503699 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:15.503663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.817354 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:15.817268    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:15.919351 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:15.919323    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:17.526624 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:17.526587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:17.590276 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:17.590250    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:19.849480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:19.849437    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:57:19.851945 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:19.851919    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7c5f32c8-bc79-41a4-b1dd-e0c38d795891-metrics-certs\") pod \"network-metrics-daemon-cqb5z\" (UID: \"7c5f32c8-bc79-41a4-b1dd-e0c38d795891\") " pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:57:19.931674 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:19.931645    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-9zbh8\""
Jul 09 14:57:19.939203 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:19.939186    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-cqb5z"
Jul 09 14:57:20.067011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:20.066956    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-cqb5z"]
Jul 09 14:57:20.069833 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:20.069805    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c5f32c8_bc79_41a4_b1dd_e0c38d795891.slice/crio-8487e845d867c9dcc0b92ccddd410c1b21c7f1c2df0e487727e0cc99dc7eec6b WatchSource:0}: Error finding container 8487e845d867c9dcc0b92ccddd410c1b21c7f1c2df0e487727e0cc99dc7eec6b: Status 404 returned error can't find the container with id 8487e845d867c9dcc0b92ccddd410c1b21c7f1c2df0e487727e0cc99dc7eec6b
Jul 09 14:57:20.640662 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:20.640626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqb5z" event={"ID":"7c5f32c8-bc79-41a4-b1dd-e0c38d795891","Type":"ContainerStarted","Data":"8487e845d867c9dcc0b92ccddd410c1b21c7f1c2df0e487727e0cc99dc7eec6b"}
Jul 09 14:57:21.645480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:21.645445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqb5z" event={"ID":"7c5f32c8-bc79-41a4-b1dd-e0c38d795891","Type":"ContainerStarted","Data":"fb3f1676eff5e724031e7689cad6ef0e440548630c594e7e6f16b8b294f24a2f"}
Jul 09 14:57:21.645853 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:21.645496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-cqb5z" event={"ID":"7c5f32c8-bc79-41a4-b1dd-e0c38d795891","Type":"ContainerStarted","Data":"ea4bdc83a5bbf1e47d0ce6672465943c735b937f7e1c007ec3f5606382369ea6"}
Jul 09 14:57:21.666360 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:21.666320    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-cqb5z" podStartSLOduration=130.572983204 podStartE2EDuration="2m11.66630613s" totalImagesPullingTime="1.093322926s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:21.666105109 +0000 UTC m=+132.081290186" watchObservedRunningTime="2026-07-09 14:57:21.66630613 +0000 UTC m=+132.081491205"
Jul 09 14:57:23.058868 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.058833    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-58bd7b847d-55k72"]
Jul 09 14:57:23.061093 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.061074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.065476 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.065460    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 09 14:57:23.067838 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.067818    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 09 14:57:23.067943 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.067865    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 09 14:57:23.068118 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.068105    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vdfrd\""
Jul 09 14:57:23.072236 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.072215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:57:23.075062 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.075038    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1e2df791-0ddf-41d0-a89e-800064af51fd-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-cd665\" (UID: \"1e2df791-0ddf-41d0-a89e-800064af51fd\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:57:23.078800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.078779    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 09 14:57:23.088671 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.088651    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bd7b847d-55k72"]
Jul 09 14:57:23.125113 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.125091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.172873 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.172848    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16403a6e-dbba-4e5a-b02e-40c6dd5783af-ca-trust-extracted\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173012 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.172885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc5zh\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-kube-api-access-mc5zh\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173012 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.172913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-tls\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173117 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.173042    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-bound-sa-token\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173117 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.173090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-image-registry-private-configuration\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173117 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.173108    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-installation-pull-secrets\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173239 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.173130    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-certificates\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.173239 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.173145    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-trusted-ca\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.213520 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.213490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.273927 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.273900    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-bound-sa-token\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274086 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.273945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-image-registry-private-configuration\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274086 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.273964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-installation-pull-secrets\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274086 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.273982    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-certificates\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274086 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-trusted-ca\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274273 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16403a6e-dbba-4e5a-b02e-40c6dd5783af-ca-trust-extracted\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274273 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc5zh\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-kube-api-access-mc5zh\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274273 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274225    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-tls\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274621 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274587    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/16403a6e-dbba-4e5a-b02e-40c6dd5783af-ca-trust-extracted\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.274916 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.274851    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-certificates\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.275319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.275296    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/16403a6e-dbba-4e5a-b02e-40c6dd5783af-trusted-ca\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.276629 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.276610    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-registry-tls\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.276726 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.276652    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-installation-pull-secrets\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.276788 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.276767    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/16403a6e-dbba-4e5a-b02e-40c6dd5783af-image-registry-private-configuration\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.284101 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.284078    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-bound-sa-token\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.284189 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.284142    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc5zh\" (UniqueName: \"kubernetes.io/projected/16403a6e-dbba-4e5a-b02e-40c6dd5783af-kube-api-access-mc5zh\") pod \"image-registry-58bd7b847d-55k72\" (UID: \"16403a6e-dbba-4e5a-b02e-40c6dd5783af\") " pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.315158 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.315092    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.355085 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.355063    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6m5w2\""
Jul 09 14:57:23.363424 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.363399    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"
Jul 09 14:57:23.370775 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.370755    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.413739 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.413686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.506187 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.506160    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665"]
Jul 09 14:57:23.509311 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:23.509283    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e2df791_0ddf_41d0_a89e_800064af51fd.slice/crio-df456958c539a9511ec207822033858cf03e4d469694778dac50dfe54a4d5565 WatchSource:0}: Error finding container df456958c539a9511ec207822033858cf03e4d469694778dac50dfe54a4d5565: Status 404 returned error can't find the container with id df456958c539a9511ec207822033858cf03e4d469694778dac50dfe54a4d5565
Jul 09 14:57:23.530242 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.530218    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-58bd7b847d-55k72"]
Jul 09 14:57:23.532598 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:23.532576    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16403a6e_dbba_4e5a_b02e_40c6dd5783af.slice/crio-d27f2e86e74ad4b41dc6cbeda38d9f8dced8c3db6e0cb6354ab678da2113fd88 WatchSource:0}: Error finding container d27f2e86e74ad4b41dc6cbeda38d9f8dced8c3db6e0cb6354ab678da2113fd88: Status 404 returned error can't find the container with id d27f2e86e74ad4b41dc6cbeda38d9f8dced8c3db6e0cb6354ab678da2113fd88
Jul 09 14:57:23.570864 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.570829    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.653586 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.653556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bd7b847d-55k72" event={"ID":"16403a6e-dbba-4e5a-b02e-40c6dd5783af","Type":"ContainerStarted","Data":"5e82436236a19123aa59f229d7d66f6c4764ab38aa31f72bceba0960485e7202"}
Jul 09 14:57:23.653732 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.653606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-58bd7b847d-55k72" event={"ID":"16403a6e-dbba-4e5a-b02e-40c6dd5783af","Type":"ContainerStarted","Data":"d27f2e86e74ad4b41dc6cbeda38d9f8dced8c3db6e0cb6354ab678da2113fd88"}
Jul 09 14:57:23.653732 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.653646    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:23.654704 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.654674    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665" event={"ID":"1e2df791-0ddf-41d0-a89e-800064af51fd","Type":"ContainerStarted","Data":"df456958c539a9511ec207822033858cf03e4d469694778dac50dfe54a4d5565"}
Jul 09 14:57:23.671202 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.671176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:23.677376 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.677327    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-58bd7b847d-55k72" podStartSLOduration=0.67731127 podStartE2EDuration="677.31127ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:23.676261667 +0000 UTC m=+134.091446743" watchObservedRunningTime="2026-07-09 14:57:23.67731127 +0000 UTC m=+134.092496345"
Jul 09 14:57:23.738784 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.738754    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:57:23.741122 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.741106    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.744615 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 09 14:57:23.744615 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744504    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 09 14:57:23.744615 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 09 14:57:23.744615 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744539    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 09 14:57:23.744876 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744787    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-rz7k5\""
Jul 09 14:57:23.744876 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.744801    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 09 14:57:23.745250 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.745234    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 09 14:57:23.745317 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.745261    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 09 14:57:23.754336 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.754316    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:57:23.879301 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpzj2\" (UniqueName: \"kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.879301 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879259    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.879496 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879359    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.879496 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879389    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.879574 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.879574 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.879561    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980152 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980112    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980159    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980208    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980244    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980280    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpzj2\" (UniqueName: \"kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.980319 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.980313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.981106 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.981080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.981251 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.981080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.981400 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.981375    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.982933 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.982904    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.983589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.983569    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:23.990566 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:23.990532    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpzj2\" (UniqueName: \"kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2\") pod \"console-647b9fd4f9-8qn4m\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") " pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:24.050282 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:24.050257    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:24.201936 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:24.201912    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:57:24.204424 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:24.204386    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod027ed20e_1187_43de_839a_4ca2531804da.slice/crio-403bafbe740a35c58bdda813f0da5f46a72aea80d6b065e638731814c1a6e13b WatchSource:0}: Error finding container 403bafbe740a35c58bdda813f0da5f46a72aea80d6b065e638731814c1a6e13b: Status 404 returned error can't find the container with id 403bafbe740a35c58bdda813f0da5f46a72aea80d6b065e638731814c1a6e13b
Jul 09 14:57:24.663250 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:24.662838    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b9fd4f9-8qn4m" event={"ID":"027ed20e-1187-43de-839a-4ca2531804da","Type":"ContainerStarted","Data":"403bafbe740a35c58bdda813f0da5f46a72aea80d6b065e638731814c1a6e13b"}
Jul 09 14:57:25.351368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.351282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.445798 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.445717    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.517314 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.517278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.591236 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.591201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:25.668551 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.668471    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665" event={"ID":"1e2df791-0ddf-41d0-a89e-800064af51fd","Type":"ContainerStarted","Data":"58a92acdba5121c77a18b822c648100b0d7e232f372c991c2797772fee334b03"}
Jul 09 14:57:25.690719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.690673    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-cd665" podStartSLOduration=33.194134201 podStartE2EDuration="34.690657467s" totalImagesPullingTime="1.496523266s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:56:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:25.689767388 +0000 UTC m=+136.104952465" watchObservedRunningTime="2026-07-09 14:57:25.690657467 +0000 UTC m=+136.105842543"
Jul 09 14:57:25.719004 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:25.718954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:27.208281 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:27.208249    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:27.210905 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:27.210881    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/bd011838-6e44-44ff-8f1e-d7c8acaed378-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-tvsqx\" (UID: \"bd011838-6e44-44ff-8f1e-d7c8acaed378\") " pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:27.458900 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:27.458812    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-cq4x2\""
Jul 09 14:57:27.465893 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:27.465856    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-tvsqx"
Jul 09 14:57:28.059626 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.059599    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-tvsqx"]
Jul 09 14:57:28.061560 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:28.061535    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd011838_6e44_44ff_8f1e_d7c8acaed378.slice/crio-d7fdf8836ae1b751dc7c1492dea7f9eb0f412aaf8dc6c31d1d7d806900f62c0f WatchSource:0}: Error finding container d7fdf8836ae1b751dc7c1492dea7f9eb0f412aaf8dc6c31d1d7d806900f62c0f: Status 404 returned error can't find the container with id d7fdf8836ae1b751dc7c1492dea7f9eb0f412aaf8dc6c31d1d7d806900f62c0f
Jul 09 14:57:28.331554 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.331525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.399832 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.399803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.576029 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.575973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.671707 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.671633    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:28.684194 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.683441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b9fd4f9-8qn4m" event={"ID":"027ed20e-1187-43de-839a-4ca2531804da","Type":"ContainerStarted","Data":"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"}
Jul 09 14:57:28.686514 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.686490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvsqx" event={"ID":"bd011838-6e44-44ff-8f1e-d7c8acaed378","Type":"ContainerStarted","Data":"d7fdf8836ae1b751dc7c1492dea7f9eb0f412aaf8dc6c31d1d7d806900f62c0f"}
Jul 09 14:57:28.705461 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:28.705362    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-647b9fd4f9-8qn4m" podStartSLOduration=1.951774543 podStartE2EDuration="5.705347514s" totalImagesPullingTime="3.753572971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:28.705280981 +0000 UTC m=+139.120466059" watchObservedRunningTime="2026-07-09 14:57:28.705347514 +0000 UTC m=+139.120532591"
Jul 09 14:57:29.227007 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:29.226954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:29.959908 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:29.959874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:30.034746 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:30.034714    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:31.128849 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:31.128810    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:31.195098 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:31.195060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:32.703485 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:32.703456    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvsqx" event={"ID":"bd011838-6e44-44ff-8f1e-d7c8acaed378","Type":"ContainerStarted","Data":"f9f6739911536145619e6548a729ee9972708f9be3b343f6221632fdbceaf701"}
Jul 09 14:57:33.708952 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:33.708906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvsqx" event={"ID":"bd011838-6e44-44ff-8f1e-d7c8acaed378","Type":"ContainerStarted","Data":"cfdb533d546d5c1fbf0be345461ab69733c219812c11abd904e1b3c1204ffff3"}
Jul 09 14:57:34.051237 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:34.051155    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:34.051237 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:34.051211    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:34.056457 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:34.056433    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:34.194479 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:34.194421    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:34.718981 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:34.718948    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:57:35.717812 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:35.717779    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-tvsqx" event={"ID":"bd011838-6e44-44ff-8f1e-d7c8acaed378","Type":"ContainerStarted","Data":"55c5db5f847b381195d29baa2f2f2a10079ee83a999a34f62055004f5c28e8f7"}
Jul 09 14:57:35.739294 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:35.739250    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-tvsqx" podStartSLOduration=33.750602471 podStartE2EDuration="40.73923655s" totalImagesPullingTime="6.988634079s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 14:56:55 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:35.738029361 +0000 UTC m=+146.153214436" watchObservedRunningTime="2026-07-09 14:57:35.73923655 +0000 UTC m=+146.154421626"
Jul 09 14:57:36.324935 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.324885    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.391357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.391321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.775732 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.775696    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.965234 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.965205    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:36.987270 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.987237    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"]
Jul 09 14:57:36.990343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.990327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:36.993109 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.993088    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jul 09 14:57:36.994237 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.994208    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jul 09 14:57:36.994237 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.994225    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 09 14:57:36.994383 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:36.994269    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-tfj5f\""
Jul 09 14:57:37.004623 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.004601    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"]
Jul 09 14:57:37.013462 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.013444    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-dpqgz"]
Jul 09 14:57:37.016334 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.016319    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.019267 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.019237    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 09 14:57:37.019377 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.019270    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 09 14:57:37.019879 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.019862    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rxjfj\""
Jul 09 14:57:37.019949 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.019882    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 09 14:57:37.055515 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.055452    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.082620 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082600    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-sys\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082729 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082627    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wm2w\" (UniqueName: \"kubernetes.io/projected/437e409a-1b16-49fc-a90b-4c2ac754f06e-kube-api-access-9wm2w\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.082729 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082648    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082729 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082672    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-tls\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082729 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082714    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082748    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.082932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082770    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxtbp\" (UniqueName: \"kubernetes.io/projected/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-kube-api-access-mxtbp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082815    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-root\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.082932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082852    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.082932 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082922    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-metrics-client-ca\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.083156 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082959    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-textfile\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.083156 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.082985    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437e409a-1b16-49fc-a90b-4c2ac754f06e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.083156 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.083059    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-wtmp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.119102 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.119074    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.183467 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-metrics-client-ca\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183478    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-textfile\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183496    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437e409a-1b16-49fc-a90b-4c2ac754f06e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.183563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183515    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-wtmp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183563 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183539    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-sys\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183588    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-sys\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wm2w\" (UniqueName: \"kubernetes.io/projected/437e409a-1b16-49fc-a90b-4c2ac754f06e-kube-api-access-9wm2w\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.183751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183669    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-wtmp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183698    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.183751 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-tls\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183805    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-textfile\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183832    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxtbp\" (UniqueName: \"kubernetes.io/projected/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-kube-api-access-mxtbp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183867    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-root\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183895    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.184011 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.183958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-root\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184343 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:37.184067    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 14:57:37.184343 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:37.184130    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls podName:437e409a-1b16-49fc-a90b-4c2ac754f06e nodeName:}" failed. No retries permitted until 2026-07-09 14:57:37.684113259 +0000 UTC m=+148.099298315 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-bczpn" (UID: "437e409a-1b16-49fc-a90b-4c2ac754f06e") : secret "openshift-state-metrics-tls" not found
Jul 09 14:57:37.184343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.184201    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-metrics-client-ca\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.184343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.184284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/437e409a-1b16-49fc-a90b-4c2ac754f06e-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.184343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.184299    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-accelerators-collector-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.186252 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.186232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.186343 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.186310    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.186466 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.186449    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-node-exporter-tls\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.192985 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.192965    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxtbp\" (UniqueName: \"kubernetes.io/projected/c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e-kube-api-access-mxtbp\") pod \"node-exporter-dpqgz\" (UID: \"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e\") " pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.193647 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.193623    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wm2w\" (UniqueName: \"kubernetes.io/projected/437e409a-1b16-49fc-a90b-4c2ac754f06e-kube-api-access-9wm2w\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.324596 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.324516    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-dpqgz"
Jul 09 14:57:37.337228 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:37.337201    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1bfe0f2_b1ea_4f77_ab3d_1e359744dc2e.slice/crio-ca241bf6f2ed990385b270e819ddf53f1d693a5e878a8ebed923456ed8d37acd WatchSource:0}: Error finding container ca241bf6f2ed990385b270e819ddf53f1d693a5e878a8ebed923456ed8d37acd: Status 404 returned error can't find the container with id ca241bf6f2ed990385b270e819ddf53f1d693a5e878a8ebed923456ed8d37acd
Jul 09 14:57:37.366594 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.366555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.680868 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.680791    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.687900 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.687875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:37.688052 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:37.688037    2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jul 09 14:57:37.688108 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:37.688097    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls podName:437e409a-1b16-49fc-a90b-4c2ac754f06e nodeName:}" failed. No retries permitted until 2026-07-09 14:57:38.688083077 +0000 UTC m=+149.103268131 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-bczpn" (UID: "437e409a-1b16-49fc-a90b-4c2ac754f06e") : secret "openshift-state-metrics-tls" not found
Jul 09 14:57:37.725787 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.725761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpqgz" event={"ID":"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e","Type":"ContainerStarted","Data":"ca241bf6f2ed990385b270e819ddf53f1d693a5e878a8ebed923456ed8d37acd"}
Jul 09 14:57:37.890565 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.890531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:37.991701 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:37.991649    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.097068 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.096978    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.099239 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.099216    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:57:38.107513 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.107493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.114203 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.114182    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 09 14:57:38.114328 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.114262    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 09 14:57:38.114766 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.114613    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 09 14:57:38.114842 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.114805    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 09 14:57:38.115075 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 09 14:57:38.115291 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115162    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-tp548\""
Jul 09 14:57:38.115291 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115192    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 09 14:57:38.115451 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115332    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 09 14:57:38.115511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115473    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 09 14:57:38.115762 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.115741    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 09 14:57:38.124124 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.124105    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:57:38.192160 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192132    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192173    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192222    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192258    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-web-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192287    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192305    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4bqvc\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-kube-api-access-4bqvc\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192572 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192572 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192410    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-config-out\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192572 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192442    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192572 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192525    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192572 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192587    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.192820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.192657    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.221640 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.221539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.293904 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.293826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.293904 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.293869    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.293904 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.293896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.293942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.293980    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294042    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294105    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-web-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294136    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294160    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4bqvc\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-kube-api-access-4bqvc\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294202    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294632 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-config-out\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294632 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.294261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.294632 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:38.294429    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle podName:906d9488-d716-4b74-9448-dc14640604b2 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:38.794406442 +0000 UTC m=+149.209591516 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "906d9488-d716-4b74-9448-dc14640604b2") : configmap references non-existent config key: ca-bundle.crt
Jul 09 14:57:38.295142 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:38.295116    2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jul 09 14:57:38.295241 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:38.295192    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls podName:906d9488-d716-4b74-9448-dc14640604b2 nodeName:}" failed. No retries permitted until 2026-07-09 14:57:38.795173849 +0000 UTC m=+149.210358903 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "906d9488-d716-4b74-9448-dc14640604b2") : secret "alertmanager-main-tls" not found
Jul 09 14:57:38.296178 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.296149    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.296873 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.296850    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.297110 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.296890    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-config-volume\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.297850 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.297809    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.298245 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.298217    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.298644 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.298626    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.298862 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.298842    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/906d9488-d716-4b74-9448-dc14640604b2-config-out\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.299263 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.299237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.300162 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.300119    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-web-config\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.301306 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.301284    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-tls-assets\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.313344 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.313323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4bqvc\" (UniqueName: \"kubernetes.io/projected/906d9488-d716-4b74-9448-dc14640604b2-kube-api-access-4bqvc\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.476382 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.476348    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:38.698434 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.698409    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:38.700535 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.700505    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/437e409a-1b16-49fc-a90b-4c2ac754f06e-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-bczpn\" (UID: \"437e409a-1b16-49fc-a90b-4c2ac754f06e\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:38.730841 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.730813    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e" containerID="85c99082fb80862366e3ef19915bdab059138360af2f7ccca49487e47b6048f5" exitCode=0
Jul 09 14:57:38.730925 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.730904    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpqgz" event={"ID":"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e","Type":"ContainerDied","Data":"85c99082fb80862366e3ef19915bdab059138360af2f7ccca49487e47b6048f5"}
Jul 09 14:57:38.798833 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.798810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.798913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.798841    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"
Jul 09 14:57:38.798913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.798882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.799820 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.799793    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/906d9488-d716-4b74-9448-dc14640604b2-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.801393 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.801368    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/906d9488-d716-4b74-9448-dc14640604b2-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"906d9488-d716-4b74-9448-dc14640604b2\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:38.940573 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:38.940543    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn"]
Jul 09 14:57:38.943478 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:38.943449    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod437e409a_1b16_49fc_a90b_4c2ac754f06e.slice/crio-e2e31320da8170e89d10a3a88b1ab1565602fa21da7de7341fb83fcc09bdc0ea WatchSource:0}: Error finding container e2e31320da8170e89d10a3a88b1ab1565602fa21da7de7341fb83fcc09bdc0ea: Status 404 returned error can't find the container with id e2e31320da8170e89d10a3a88b1ab1565602fa21da7de7341fb83fcc09bdc0ea
Jul 09 14:57:39.019128 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.019105    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 09 14:57:39.165416 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.165390    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 09 14:57:39.167659 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:39.167635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod906d9488_d716_4b74_9448_dc14640604b2.slice/crio-193163e0b373a9f68e6633d52fdf53a18f158402e89ec5d4d30f4a1e70d931d0 WatchSource:0}: Error finding container 193163e0b373a9f68e6633d52fdf53a18f158402e89ec5d4d30f4a1e70d931d0: Status 404 returned error can't find the container with id 193163e0b373a9f68e6633d52fdf53a18f158402e89ec5d4d30f4a1e70d931d0
Jul 09 14:57:39.736480 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.736376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"193163e0b373a9f68e6633d52fdf53a18f158402e89ec5d4d30f4a1e70d931d0"}
Jul 09 14:57:39.738893 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.738859    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpqgz" event={"ID":"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e","Type":"ContainerStarted","Data":"3137a8e7d94216900147c55225f76b9f8c0d2b03d667780a985ac92fcc73e4f0"}
Jul 09 14:57:39.738893 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.738921    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-dpqgz" event={"ID":"c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e","Type":"ContainerStarted","Data":"e8cb3afdec020c0c15be306a7831316061be555b6393901850b3dd7758464886"}
Jul 09 14:57:39.740888 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.740863    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn" event={"ID":"437e409a-1b16-49fc-a90b-4c2ac754f06e","Type":"ContainerStarted","Data":"186c021c87a7a277e847d60aff9ea04461f112bed7351765487ae1e8ba2d89b3"}
Jul 09 14:57:39.740979 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.740929    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn" event={"ID":"437e409a-1b16-49fc-a90b-4c2ac754f06e","Type":"ContainerStarted","Data":"f1288a136cad3771e38b2d4ca4c1d025e0f20df497ced6987fdc88eab5f52f35"}
Jul 09 14:57:39.740979 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.740960    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn" event={"ID":"437e409a-1b16-49fc-a90b-4c2ac754f06e","Type":"ContainerStarted","Data":"e2e31320da8170e89d10a3a88b1ab1565602fa21da7de7341fb83fcc09bdc0ea"}
Jul 09 14:57:39.763624 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:39.763555    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-dpqgz" podStartSLOduration=2.5307482390000002 podStartE2EDuration="3.763537903s" totalImagesPullingTime="1.161958292s" totalInitContainerRuntime="70.831372ms" isStatefulPod=true podCreationTimestamp="2026-07-09 14:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:39.761814526 +0000 UTC m=+150.176999606" watchObservedRunningTime="2026-07-09 14:57:39.763537903 +0000 UTC m=+150.178722980"
Jul 09 14:57:40.014102 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.014021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.124379 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.124188    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.369273 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.369079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.463471 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.463438    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.563640 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.563596    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:40.746444 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.746412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn" event={"ID":"437e409a-1b16-49fc-a90b-4c2ac754f06e","Type":"ContainerStarted","Data":"0c8664a41d3a2c8ce2e400957861c45413c76b44a5434e90e64029edc78aa761"}
Jul 09 14:57:40.771354 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:40.771312    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-bczpn" podStartSLOduration=3.669895027 podStartE2EDuration="4.771295206s" totalImagesPullingTime="1.101400179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:40.768710973 +0000 UTC m=+151.183896055" watchObservedRunningTime="2026-07-09 14:57:40.771295206 +0000 UTC m=+151.186480311"
Jul 09 14:57:41.444582 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.444549    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"]
Jul 09 14:57:41.447618 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.447603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.450375 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.450343    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jul 09 14:57:41.450375 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.450355    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jul 09 14:57:41.451600 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.451578    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-82pc4\""
Jul 09 14:57:41.451749 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.451647    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jul 09 14:57:41.451749 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.451658    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 09 14:57:41.451749 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.451691    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-as4t7cl4uevs8\""
Jul 09 14:57:41.461187 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.461166    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"]
Jul 09 14:57:41.492309 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.492283    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:41.520574 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520550    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-client-certs\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520662 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-metrics-server-audit-profiles\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520662 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520662 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520625    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmvj5\" (UniqueName: \"kubernetes.io/projected/267c4f2a-b28d-4167-8791-2fd03e8d93ae-kube-api-access-hmvj5\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520775 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520684    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-client-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520775 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-tls\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.520775 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.520743    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267c4f2a-b28d-4167-8791-2fd03e8d93ae-audit-log\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.561053 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.561033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:41.621795 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-client-certs\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.621903 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621797    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-metrics-server-audit-profiles\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.621903 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621814    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.621903 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621840    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmvj5\" (UniqueName: \"kubernetes.io/projected/267c4f2a-b28d-4167-8791-2fd03e8d93ae-kube-api-access-hmvj5\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.621903 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621876    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-client-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.622137 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-tls\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.622137 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.621945    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267c4f2a-b28d-4167-8791-2fd03e8d93ae-audit-log\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.622373 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.622343    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/267c4f2a-b28d-4167-8791-2fd03e8d93ae-audit-log\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.622650 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.622580    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.623103 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.623080    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/267c4f2a-b28d-4167-8791-2fd03e8d93ae-metrics-server-audit-profiles\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.624450 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.624431    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-client-ca-bundle\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.624579 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.624557    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-tls\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.624638 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.624585    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/267c4f2a-b28d-4167-8791-2fd03e8d93ae-secret-metrics-server-client-certs\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.631218 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.631193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmvj5\" (UniqueName: \"kubernetes.io/projected/267c4f2a-b28d-4167-8791-2fd03e8d93ae-kube-api-access-hmvj5\") pod \"metrics-server-57d9fdfb9c-8xtjj\" (UID: \"267c4f2a-b28d-4167-8791-2fd03e8d93ae\") " pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.751389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.751362    2578 generic.go:356] "Generic (PLEG): container finished" podID="906d9488-d716-4b74-9448-dc14640604b2" containerID="31c59883253d16f8106facd18dfa03b509e55af67a40c8ef07332922ed3c3c2b" exitCode=0
Jul 09 14:57:41.751540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.751443    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerDied","Data":"31c59883253d16f8106facd18dfa03b509e55af67a40c8ef07332922ed3c3c2b"}
Jul 09 14:57:41.756819 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.756794    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:57:41.765607 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.765555    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:41.841148 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.841067    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:41.897772 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.897727    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"]
Jul 09 14:57:41.902297 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:41.902272    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod267c4f2a_b28d_4167_8791_2fd03e8d93ae.slice/crio-0735060c227afb365920ccb0c94fe8904ca9375f8ab6d1c209efc4e9cd1974cf WatchSource:0}: Error finding container 0735060c227afb365920ccb0c94fe8904ca9375f8ab6d1c209efc4e9cd1974cf: Status 404 returned error can't find the container with id 0735060c227afb365920ccb0c94fe8904ca9375f8ab6d1c209efc4e9cd1974cf
Jul 09 14:57:41.987649 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:41.987621    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:42.579727 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.579696    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:57:42.582911 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.582893    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.591490 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.591471    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 09 14:57:42.597743 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.597722    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:57:42.629511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629598 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629518    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629598 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629555    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpmtp\" (UniqueName: \"kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629598 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629605    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.629706 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.629683    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730578 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpmtp\" (UniqueName: \"kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730586    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730891 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730721    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.730891 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.730745    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.731511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.731468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.731511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.731468    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.731638 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.731568    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.731831 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.731798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.733705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.733681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.733879 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.733861    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.742104 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.741242    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpmtp\" (UniqueName: \"kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp\") pod \"console-f95cd658b-bzbw8\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") " pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:42.757928 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.757896    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj" event={"ID":"267c4f2a-b28d-4167-8791-2fd03e8d93ae","Type":"ContainerStarted","Data":"0735060c227afb365920ccb0c94fe8904ca9375f8ab6d1c209efc4e9cd1974cf"}
Jul 09 14:57:42.892092 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:42.892023    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:43.028384 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.028349    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:57:43.031813 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:43.031783    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db99874_6c87_46f7_bc5b_ffe02d7cbc92.slice/crio-3e2df21f2ea497153392a84d4805f501817da2e785dbb290838af0875a9f53bb WatchSource:0}: Error finding container 3e2df21f2ea497153392a84d4805f501817da2e785dbb290838af0875a9f53bb: Status 404 returned error can't find the container with id 3e2df21f2ea497153392a84d4805f501817da2e785dbb290838af0875a9f53bb
Jul 09 14:57:43.366418 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.366335    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:43.495733 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.495683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:43.767053 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.767015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95cd658b-bzbw8" event={"ID":"3db99874-6c87-46f7-bc5b-ffe02d7cbc92","Type":"ContainerStarted","Data":"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"}
Jul 09 14:57:43.767511 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.767070    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95cd658b-bzbw8" event={"ID":"3db99874-6c87-46f7-bc5b-ffe02d7cbc92","Type":"ContainerStarted","Data":"3e2df21f2ea497153392a84d4805f501817da2e785dbb290838af0875a9f53bb"}
Jul 09 14:57:43.791719 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:43.791667    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f95cd658b-bzbw8" podStartSLOduration=1.791646036 podStartE2EDuration="1.791646036s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:43.790092195 +0000 UTC m=+154.205277282" watchObservedRunningTime="2026-07-09 14:57:43.791646036 +0000 UTC m=+154.206831112"
Jul 09 14:57:44.667453 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.667387    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-58bd7b847d-55k72"
Jul 09 14:57:44.772569 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.772531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj" event={"ID":"267c4f2a-b28d-4167-8791-2fd03e8d93ae","Type":"ContainerStarted","Data":"5e5e7cc332345f18db5eacda1d6baa498f43f5cc94abbf42ec18ca3c26791b44"}
Jul 09 14:57:44.775575 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.775547    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"082ef889724b70395c04192a4777956cb2b11fc8b576b593698953e46ebcea00"}
Jul 09 14:57:44.775730 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.775613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"a65d43177118352a3b3f1f3731ba4b72545082ac87cdbbf6155bae63141981da"}
Jul 09 14:57:44.775730 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.775644    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"64272f23c09a29562b1d77edd95766dbe4355ea7f4b5e2a5d3c4bfea9e6e9498"}
Jul 09 14:57:44.775730 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.775676    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"17c8d0513a0873f27ed29b5b57d4d663721db0a5b60da1a6ef96392381c5656a"}
Jul 09 14:57:44.775730 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.775701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"824e603f17cb2009f91448a85ba00de67b7e0f196b47a4d79b3b752d1759180f"}
Jul 09 14:57:44.792565 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.792520    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj" podStartSLOduration=1.7170252769999998 podStartE2EDuration="3.792507041s" totalImagesPullingTime="2.075481764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:44.791118047 +0000 UTC m=+155.206303124" watchObservedRunningTime="2026-07-09 14:57:44.792507041 +0000 UTC m=+155.207692116"
Jul 09 14:57:44.845775 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.845748    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:44.936546 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:44.936454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:45.782476 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:45.782445    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"906d9488-d716-4b74-9448-dc14640604b2","Type":"ContainerStarted","Data":"18c57b850bcaa4bd84b07284f6897b427605cd929abf59bde2338f19ca761d10"}
Jul 09 14:57:45.820505 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:45.820464    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.8569396769999997 podStartE2EDuration="7.820450412s" totalImagesPullingTime="4.947530576s" totalInitContainerRuntime="15.980159ms" isStatefulPod=false podCreationTimestamp="2026-07-09 14:57:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:45.819438625 +0000 UTC m=+156.234623700" watchObservedRunningTime="2026-07-09 14:57:45.820450412 +0000 UTC m=+156.235635487"
Jul 09 14:57:49.342554 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:49.342523    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:49.427952 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:49.427918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:49.982047 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:57:49.982009    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5c747" podUID="f67f283a-3d39-4c54-9e36-aa5446a36d43"
Jul 09 14:57:50.801409 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:50.801379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5c747"
Jul 09 14:57:52.740170 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:52.740132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:52.840762 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:52.840732    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:52.892263 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:52.892236    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:52.892383 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:52.892319    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:52.896882 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:52.896865    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:53.816077 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:53.816050    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:57:53.871869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:53.871830    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:57:53.986540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:53.986506    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:54.086087 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:54.086011    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:54.185722 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:54.185688    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:54.255453 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:54.255408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:54.830814 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:54.830785    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:57:54.833155 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:54.833128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f67f283a-3d39-4c54-9e36-aa5446a36d43-metrics-tls\") pod \"dns-default-5c747\" (UID: \"f67f283a-3d39-4c54-9e36-aa5446a36d43\") " pod="openshift-dns/dns-default-5c747"
Jul 09 14:57:55.004868 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:55.004834    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rns85\""
Jul 09 14:57:55.012336 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:55.012317    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5c747"
Jul 09 14:57:55.142313 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:55.142285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5c747"]
Jul 09 14:57:55.145067 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:57:55.145040    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf67f283a_3d39_4c54_9e36_aa5446a36d43.slice/crio-4227ef8d7a6d11baef10f5f44c6c0a3b0015f50aad07445c315fd51c07846eb4 WatchSource:0}: Error finding container 4227ef8d7a6d11baef10f5f44c6c0a3b0015f50aad07445c315fd51c07846eb4: Status 404 returned error can't find the container with id 4227ef8d7a6d11baef10f5f44c6c0a3b0015f50aad07445c315fd51c07846eb4
Jul 09 14:57:55.821125 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:55.821084    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5c747" event={"ID":"f67f283a-3d39-4c54-9e36-aa5446a36d43","Type":"ContainerStarted","Data":"4227ef8d7a6d11baef10f5f44c6c0a3b0015f50aad07445c315fd51c07846eb4"}
Jul 09 14:57:57.286691 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.286661    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:57.387392 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.387299    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:57:57.830726 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.830693    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5c747" event={"ID":"f67f283a-3d39-4c54-9e36-aa5446a36d43","Type":"ContainerStarted","Data":"dfe7a2ee6cf13f76741ad99139a028c124d10cad22bde0bb32c9cf3fd4283d3b"}
Jul 09 14:57:57.830902 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.830768    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5c747" event={"ID":"f67f283a-3d39-4c54-9e36-aa5446a36d43","Type":"ContainerStarted","Data":"dbb75174c70a3147abc852ac1a2cabf587a11e7b342b8f114c6757e08c51755a"}
Jul 09 14:57:57.830902 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.830814    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5c747"
Jul 09 14:57:57.855320 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:57:57.855274    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5c747" podStartSLOduration=129.8917921 podStartE2EDuration="2m11.855260497s" totalImagesPullingTime="1.963468397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:55:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:57:57.854348882 +0000 UTC m=+168.269533958" watchObservedRunningTime="2026-07-09 14:57:57.855260497 +0000 UTC m=+168.270445572"
Jul 09 14:58:01.757097 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:01.757022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:58:01.757535 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:01.757105    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:58:01.843357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:01.843327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:01.915136 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:01.915104    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:04.512395 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:04.512360    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:04.612371 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:04.612342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:04.713496 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:04.713463    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:06.867947 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:06.867917    2578 generic.go:356] "Generic (PLEG): container finished" podID="8790cd51-fa0c-45f5-8c68-3a04310bb53d" containerID="ce432dbf61dc706a36651724bc18d5d86ea671030a6f8760f9a592f95fb0fe87" exitCode=0
Jul 09 14:58:06.868357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:06.867967    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd" event={"ID":"8790cd51-fa0c-45f5-8c68-3a04310bb53d","Type":"ContainerDied","Data":"ce432dbf61dc706a36651724bc18d5d86ea671030a6f8760f9a592f95fb0fe87"}
Jul 09 14:58:06.868357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:06.868240    2578 scope.go:117] "RemoveContainer" containerID="ce432dbf61dc706a36651724bc18d5d86ea671030a6f8760f9a592f95fb0fe87"
Jul 09 14:58:07.836153 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:07.836125    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5c747"
Jul 09 14:58:07.873849 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:07.873816    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-l6cnd" event={"ID":"8790cd51-fa0c-45f5-8c68-3a04310bb53d","Type":"ContainerStarted","Data":"4295ae6f12ea8c03b91be8eef1c56fe174126af9a973cf223bf51924489ef4dc"}
Jul 09 14:58:15.588665 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:15.588625    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5c747_f67f283a-3d39-4c54-9e36-aa5446a36d43/dns/0.log"
Jul 09 14:58:15.596124 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:15.596100    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5c747_f67f283a-3d39-4c54-9e36-aa5446a36d43/kube-rbac-proxy/0.log"
Jul 09 14:58:15.965585 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:15.965556    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hbxb5_ed9a78e5-6aab-4010-8d11-2e653d030f2c/dns-node-resolver/0.log"
Jul 09 14:58:16.263057 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:16.262954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:16.363817 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:16.363775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:18.899659 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:18.899596    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-647b9fd4f9-8qn4m" podUID="027ed20e-1187-43de-839a-4ca2531804da" containerName="console" containerID="cri-o://51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686" gracePeriod=15
Jul 09 14:58:19.136440 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.136416    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:58:19.222382 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rpzj2\" (UniqueName: \"kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222533 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222398    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222533 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222428    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222671 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222558    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222671 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222782 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222685    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert\") pod \"027ed20e-1187-43de-839a-4ca2531804da\" (UID: \"027ed20e-1187-43de-839a-4ca2531804da\") "
Jul 09 14:58:19.222846 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.222820    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config" (OuterVolumeSpecName: "console-config") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:19.223067 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.223035    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca" (OuterVolumeSpecName: "service-ca") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:19.223160 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.223049    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-console-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.223285 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.223257    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:58:19.224824 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.224798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2" (OuterVolumeSpecName: "kube-api-access-rpzj2") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "kube-api-access-rpzj2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:58:19.224907 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.224796    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:19.224907 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.224869    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "027ed20e-1187-43de-839a-4ca2531804da" (UID: "027ed20e-1187-43de-839a-4ca2531804da"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:58:19.324230 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.324201    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.324230 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.324224    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.324389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.324242    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/027ed20e-1187-43de-839a-4ca2531804da-oauth-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.324389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.324252    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rpzj2\" (UniqueName: \"kubernetes.io/projected/027ed20e-1187-43de-839a-4ca2531804da-kube-api-access-rpzj2\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.324389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.324260    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/027ed20e-1187-43de-839a-4ca2531804da-console-oauth-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:58:19.921734 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.921694    2578 generic.go:356] "Generic (PLEG): container finished" podID="027ed20e-1187-43de-839a-4ca2531804da" containerID="51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686" exitCode=0
Jul 09 14:58:19.922179 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.921741    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-647b9fd4f9-8qn4m"
Jul 09 14:58:19.922179 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.921778    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b9fd4f9-8qn4m" event={"ID":"027ed20e-1187-43de-839a-4ca2531804da","Type":"ContainerDied","Data":"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"}
Jul 09 14:58:19.922179 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.921846    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-647b9fd4f9-8qn4m" event={"ID":"027ed20e-1187-43de-839a-4ca2531804da","Type":"ContainerDied","Data":"403bafbe740a35c58bdda813f0da5f46a72aea80d6b065e638731814c1a6e13b"}
Jul 09 14:58:19.922179 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.921868    2578 scope.go:117] "RemoveContainer" containerID="51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"
Jul 09 14:58:19.931184 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.931168    2578 scope.go:117] "RemoveContainer" containerID="51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"
Jul 09 14:58:19.931445 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:58:19.931427    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686\": container with ID starting with 51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686 not found: ID does not exist" containerID="51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"
Jul 09 14:58:19.931495 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.931455    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686"} err="failed to get container status \"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686\": rpc error: code = NotFound desc = could not find container \"51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686\": container with ID starting with 51b08097236f00938c1b730e929cd2c01e2feb4daece9450b8476c3dd45ef686 not found: ID does not exist"
Jul 09 14:58:19.946799 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.946778    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:58:19.952928 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:19.952908    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-647b9fd4f9-8qn4m"]
Jul 09 14:58:20.122162 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:20.122133    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="027ed20e-1187-43de-839a-4ca2531804da" path="/var/lib/kubelet/pods/027ed20e-1187-43de-839a-4ca2531804da/volumes"
Jul 09 14:58:20.927619 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:20.927594    2578 generic.go:356] "Generic (PLEG): container finished" podID="f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6" containerID="95039311a05d15a3efccc4fcc69d2ecddea867295265a2a49c6a23c3ec18d478" exitCode=0
Jul 09 14:58:20.927889 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:20.927665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw" event={"ID":"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6","Type":"ContainerDied","Data":"95039311a05d15a3efccc4fcc69d2ecddea867295265a2a49c6a23c3ec18d478"}
Jul 09 14:58:20.928018 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:20.928001    2578 scope.go:117] "RemoveContainer" containerID="95039311a05d15a3efccc4fcc69d2ecddea867295265a2a49c6a23c3ec18d478"
Jul 09 14:58:21.762602 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:21.762577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:58:21.766288 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:21.766258    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-57d9fdfb9c-8xtjj"
Jul 09 14:58:21.933455 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:21.933424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-82zmw" event={"ID":"f68e25cb-d03a-4ea3-a825-c56cdd3ec7c6","Type":"ContainerStarted","Data":"616dd3da0bed4663d0b3c8fe3bd0742b9c039ab46f7400ae4f7a3a1372c5a885"}
Jul 09 14:58:26.029589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:26.029551    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:26.130357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:26.130321    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:27.305698 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:27.305658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:27.423487 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:27.423459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:40.719542 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:40.719510    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:40.825357 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:40.825318    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:44.007752 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:44.007712    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:56.354508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:56.354462    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:58:56.424779 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:58:56.424740    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:00.652802 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:00.652770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:01.449043 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.449009    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677b6c4997-7j8cw"]
Jul 09 14:59:01.449371 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.449356    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="027ed20e-1187-43de-839a-4ca2531804da" containerName="console"
Jul 09 14:59:01.449426 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.449373    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="027ed20e-1187-43de-839a-4ca2531804da" containerName="console"
Jul 09 14:59:01.449426 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.449424    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="027ed20e-1187-43de-839a-4ca2531804da" containerName="console"
Jul 09 14:59:01.451540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.451519    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.454368 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454339    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jul 09 14:59:01.454560 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454534    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jul 09 14:59:01.454680 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454602    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jul 09 14:59:01.454911 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jul 09 14:59:01.455038 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454925    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-htw9c\""
Jul 09 14:59:01.455038 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.454970    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jul 09 14:59:01.461251 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.461232    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jul 09 14:59:01.472531 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.472507    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677b6c4997-7j8cw"]
Jul 09 14:59:01.569329 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569299    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569344    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-serving-certs-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-federate-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569508 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569492    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-metrics-client-ca\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569663 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.569663 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.569565    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9m2l4\" (UniqueName: \"kubernetes.io/projected/20cd8011-2ad6-4627-b9d3-a4fcbe413562-kube-api-access-9m2l4\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670298 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670258    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-serving-certs-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670298 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670301    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670337    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-federate-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670353    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-metrics-client-ca\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9m2l4\" (UniqueName: \"kubernetes.io/projected/20cd8011-2ad6-4627-b9d3-a4fcbe413562-kube-api-access-9m2l4\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.670774 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.670491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.671177 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.671129    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-serving-certs-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.671441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.671286    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-metrics-client-ca\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.671571 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.671481    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.673116 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.673088    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-telemeter-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.673248 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.673227    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-federate-client-tls\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.673291 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.673226    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.673291 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.673271    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/20cd8011-2ad6-4627-b9d3-a4fcbe413562-secret-telemeter-client\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.680540 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.680511    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9m2l4\" (UniqueName: \"kubernetes.io/projected/20cd8011-2ad6-4627-b9d3-a4fcbe413562-kube-api-access-9m2l4\") pod \"telemeter-client-677b6c4997-7j8cw\" (UID: \"20cd8011-2ad6-4627-b9d3-a4fcbe413562\") " pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.761942 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.761908    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw"
Jul 09 14:59:01.900555 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:01.900529    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677b6c4997-7j8cw"]
Jul 09 14:59:01.902658 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:59:01.902628    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20cd8011_2ad6_4627_b9d3_a4fcbe413562.slice/crio-6f63f348c3749220a39aa26d3342c21501242458ba030fd75004ebbf720bd8a9 WatchSource:0}: Error finding container 6f63f348c3749220a39aa26d3342c21501242458ba030fd75004ebbf720bd8a9: Status 404 returned error can't find the container with id 6f63f348c3749220a39aa26d3342c21501242458ba030fd75004ebbf720bd8a9
Jul 09 14:59:02.089892 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:02.089804    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw" event={"ID":"20cd8011-2ad6-4627-b9d3-a4fcbe413562","Type":"ContainerStarted","Data":"6f63f348c3749220a39aa26d3342c21501242458ba030fd75004ebbf720bd8a9"}
Jul 09 14:59:04.098931 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:04.098901    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw" event={"ID":"20cd8011-2ad6-4627-b9d3-a4fcbe413562","Type":"ContainerStarted","Data":"8c9594788413c2b2c263f64138849988fac68e357d938c8dfb3c0307aa57447b"}
Jul 09 14:59:05.105185 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.105140    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw" event={"ID":"20cd8011-2ad6-4627-b9d3-a4fcbe413562","Type":"ContainerStarted","Data":"d004258603fc4d9b45bfd85461cf5cd3f80e6ca30aaaac5c733a02e56fb9b503"}
Jul 09 14:59:05.105573 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.105220    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw" event={"ID":"20cd8011-2ad6-4627-b9d3-a4fcbe413562","Type":"ContainerStarted","Data":"d8d10cc510fa37eefb84b9302aa860d3dd1aef37b126bed37845a68762bb0bb2"}
Jul 09 14:59:05.132833 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.132768    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677b6c4997-7j8cw" podStartSLOduration=2.052024042 podStartE2EDuration="4.132746299s" totalImagesPullingTime="2.080722257s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:05.130238376 +0000 UTC m=+235.545423454" watchObservedRunningTime="2026-07-09 14:59:05.132746299 +0000 UTC m=+235.547931378"
Jul 09 14:59:05.781952 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.781916    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:05.784250 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.784224    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.804168 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.804144    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:05.910441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910407    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh4gs\" (UniqueName: \"kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910470    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910517    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910581    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910597    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.910622 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.910611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:05.967314 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:05.967280    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.011374 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011330    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh4gs\" (UniqueName: \"kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011433    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011461    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011520    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.011570 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.011540    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.012345 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.012319    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.012557 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.012535    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.012605 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.012545    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.012605 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.012589    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.014271 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.014243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.014271 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.014256    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.020080 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.020059    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh4gs\" (UniqueName: \"kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs\") pod \"console-7dd49dfd57-vb462\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") " pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.080810 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.080685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.095779 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.095747    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:06.238705 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.238671    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:06.242361 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:59:06.242325    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05a9ed1c_efeb_47c7_8e3e_36c2758d6271.slice/crio-d87d1851c33c25f9b511a48b55afe8e8111c1e615ef66fd31b399c9e61e97ef8 WatchSource:0}: Error finding container d87d1851c33c25f9b511a48b55afe8e8111c1e615ef66fd31b399c9e61e97ef8: Status 404 returned error can't find the container with id d87d1851c33c25f9b511a48b55afe8e8111c1e615ef66fd31b399c9e61e97ef8
Jul 09 14:59:06.579665 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.579634    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:06.657035 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:06.656961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:07.115481 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:07.115449    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd49dfd57-vb462" event={"ID":"05a9ed1c-efeb-47c7-8e3e-36c2758d6271","Type":"ContainerStarted","Data":"f88d9cdb592a1d3a395e6f024dc3a2ae4edeb0985716425ce1ea74092c08c0eb"}
Jul 09 14:59:07.115663 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:07.115498    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd49dfd57-vb462" event={"ID":"05a9ed1c-efeb-47c7-8e3e-36c2758d6271","Type":"ContainerStarted","Data":"d87d1851c33c25f9b511a48b55afe8e8111c1e615ef66fd31b399c9e61e97ef8"}
Jul 09 14:59:07.138771 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:07.138724    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7dd49dfd57-vb462" podStartSLOduration=2.138706998 podStartE2EDuration="2.138706998s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:07.136719988 +0000 UTC m=+237.551905065" watchObservedRunningTime="2026-07-09 14:59:07.138706998 +0000 UTC m=+237.553892074"
Jul 09 14:59:11.649948 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:11.649904    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:11.752275 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:11.752238    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:14.047286 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.047248    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:14.082287 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.082251    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 14:59:14.086778 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.086753    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.099115 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.099087    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 14:59:14.186734 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186694    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.186913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186742    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.186913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.186913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186888    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.186913 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.187082 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186931    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.187082 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.186954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84pgj\" (UniqueName: \"kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287683 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287771    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.287869 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287856    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.288136 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.287877    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84pgj\" (UniqueName: \"kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.288585 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.288561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.288690 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.288561    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.288690 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.288595    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.288919 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.288899    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.290441 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.290419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.290672 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.290650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.297846 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.297790    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84pgj\" (UniqueName: \"kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj\") pod \"console-57546d5dfc-n9lqw\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") " pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.395871 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.395830    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:14.439092 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.439032    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:14.536103 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.536076    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 14:59:14.538506 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:59:14.538478    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3be0836_b67f_413a_be93_feda92e04bdc.slice/crio-7f4cc6035d83ac11bdac4015fe26143a4ee963e1a2cd1e73e7b064186bad60fa WatchSource:0}: Error finding container 7f4cc6035d83ac11bdac4015fe26143a4ee963e1a2cd1e73e7b064186bad60fa: Status 404 returned error can't find the container with id 7f4cc6035d83ac11bdac4015fe26143a4ee963e1a2cd1e73e7b064186bad60fa
Jul 09 14:59:14.540271 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:14.540126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:15.120627 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:15.120592    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:15.152152 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:15.152123    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57546d5dfc-n9lqw" event={"ID":"c3be0836-b67f-413a-be93-feda92e04bdc","Type":"ContainerStarted","Data":"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"}
Jul 09 14:59:15.152306 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:15.152171    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57546d5dfc-n9lqw" event={"ID":"c3be0836-b67f-413a-be93-feda92e04bdc","Type":"ContainerStarted","Data":"7f4cc6035d83ac11bdac4015fe26143a4ee963e1a2cd1e73e7b064186bad60fa"}
Jul 09 14:59:15.174703 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:15.174650    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57546d5dfc-n9lqw" podStartSLOduration=1.174633283 podStartE2EDuration="1.174633283s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 14:59:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 14:59:15.172455712 +0000 UTC m=+245.587640789" watchObservedRunningTime="2026-07-09 14:59:15.174633283 +0000 UTC m=+245.589818359"
Jul 09 14:59:15.279381 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:15.279339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:16.096902 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:16.096852    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:23.618657 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:23.618617    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:23.719190 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:23.719160    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:24.396121 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:24.396069    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:24.396121 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:24.396129    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:24.400924 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:24.400900    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:25.193772 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:25.193747    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 14:59:25.250463 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:25.250426    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:59:25.375573 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:25.375539    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:25.476633 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:25.476602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:25.578112 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:25.578076    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:27.317689 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:27.317654    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:27.403524 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:27.403486    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:39.068389 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.068294    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7dd49dfd57-vb462" podUID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" containerName="console" containerID="cri-o://f88d9cdb592a1d3a395e6f024dc3a2ae4edeb0985716425ce1ea74092c08c0eb" gracePeriod=15
Jul 09 14:59:39.251516 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.251485    2578 generic.go:356] "Generic (PLEG): container finished" podID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" containerID="f88d9cdb592a1d3a395e6f024dc3a2ae4edeb0985716425ce1ea74092c08c0eb" exitCode=0
Jul 09 14:59:39.251676 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.251531    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd49dfd57-vb462" event={"ID":"05a9ed1c-efeb-47c7-8e3e-36c2758d6271","Type":"ContainerDied","Data":"f88d9cdb592a1d3a395e6f024dc3a2ae4edeb0985716425ce1ea74092c08c0eb"}
Jul 09 14:59:39.331920 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.331862    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:39.398354 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398323    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh4gs\" (UniqueName: \"kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398528 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398371    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398528 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398393    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398528 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398412    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398678 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398730 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398687    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398783 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398748    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert\") pod \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\" (UID: \"05a9ed1c-efeb-47c7-8e3e-36c2758d6271\") "
Jul 09 14:59:39.398783 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398761    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config" (OuterVolumeSpecName: "console-config") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:39.398874 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398810    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:39.399016 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.398969    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:39.399152 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.399111    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca" (OuterVolumeSpecName: "service-ca") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:39.399397 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.399250    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-oauth-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.399397 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.399282    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-trusted-ca-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.399397 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.399295    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.400800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.400774    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:39.400800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.400792    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:39.400800 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.400794    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs" (OuterVolumeSpecName: "kube-api-access-lh4gs") pod "05a9ed1c-efeb-47c7-8e3e-36c2758d6271" (UID: "05a9ed1c-efeb-47c7-8e3e-36c2758d6271"). InnerVolumeSpecName "kube-api-access-lh4gs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:39.499940 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.499912    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.499940 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.499937    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh4gs\" (UniqueName: \"kubernetes.io/projected/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-kube-api-access-lh4gs\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.500137 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.499956    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-console-oauth-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:39.500137 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:39.499965    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/05a9ed1c-efeb-47c7-8e3e-36c2758d6271-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:40.256561 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:40.256518    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7dd49dfd57-vb462" event={"ID":"05a9ed1c-efeb-47c7-8e3e-36c2758d6271","Type":"ContainerDied","Data":"d87d1851c33c25f9b511a48b55afe8e8111c1e615ef66fd31b399c9e61e97ef8"}
Jul 09 14:59:40.256561 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:40.256538    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7dd49dfd57-vb462"
Jul 09 14:59:40.257068 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:40.256589    2578 scope.go:117] "RemoveContainer" containerID="f88d9cdb592a1d3a395e6f024dc3a2ae4edeb0985716425ce1ea74092c08c0eb"
Jul 09 14:59:40.276050 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:40.275978    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:40.280281 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:40.280255    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7dd49dfd57-vb462"]
Jul 09 14:59:42.123173 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:42.123138    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" path="/var/lib/kubelet/pods/05a9ed1c-efeb-47c7-8e3e-36c2758d6271/volumes"
Jul 09 14:59:42.745414 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:42.745382    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:42.846035 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:42.845973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:44.247306 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.247273    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"]
Jul 09 14:59:44.247718 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.247567    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" containerName="console"
Jul 09 14:59:44.247718 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.247577    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" containerName="console"
Jul 09 14:59:44.247718 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.247641    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="05a9ed1c-efeb-47c7-8e3e-36c2758d6271" containerName="console"
Jul 09 14:59:44.251127 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.251112    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.253970 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.253950    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 14:59:44.254127 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.254050    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 14:59:44.255401 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.255380    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h4792\""
Jul 09 14:59:44.260892 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.260866    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"]
Jul 09 14:59:44.341504 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.341468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nc2cj\" (UniqueName: \"kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.341504 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.341508    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.341720 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.341559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.442036 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.441974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nc2cj\" (UniqueName: \"kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.442204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.442067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.442204 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.442125    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.442476 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.442452    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.442513 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.442473    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.452451 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.452426    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nc2cj\" (UniqueName: \"kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.560826 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.560738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 14:59:44.717267 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:44.717236    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"]
Jul 09 14:59:44.720883 ip-10-0-129-1 kubenswrapper[2578]: W0709 14:59:44.720857    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b0650cb_5b66_464f_bdc7_05d2e9bc969d.slice/crio-746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408 WatchSource:0}: Error finding container 746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408: Status 404 returned error can't find the container with id 746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408
Jul 09 14:59:45.279892 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:45.279853    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb" event={"ID":"1b0650cb-5b66-464f-bdc7-05d2e9bc969d","Type":"ContainerStarted","Data":"746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408"}
Jul 09 14:59:45.767731 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:45.767668    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 14:59:50.272777 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.272735    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-f95cd658b-bzbw8" podUID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" containerName="console" containerID="cri-o://7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e" gracePeriod=15
Jul 09 14:59:50.303259 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.303223    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerID="2d02575dbe7a4a8c8edb9a9b9cf9ca2748d3d544aaa52cab771770d92542f098" exitCode=0
Jul 09 14:59:50.303391 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.303261    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb" event={"ID":"1b0650cb-5b66-464f-bdc7-05d2e9bc969d","Type":"ContainerDied","Data":"2d02575dbe7a4a8c8edb9a9b9cf9ca2748d3d544aaa52cab771770d92542f098"}
Jul 09 14:59:50.524778 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.524718    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:59:50.598049 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598049 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598061    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598116    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598180    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598212    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598299 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598250    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpmtp\" (UniqueName: \"kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598483 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598330    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert\") pod \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\" (UID: \"3db99874-6c87-46f7-bc5b-ffe02d7cbc92\") "
Jul 09 14:59:50.598483 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598463    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config" (OuterVolumeSpecName: "console-config") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:50.598663 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598642    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.598722 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598661    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:50.598722 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598678    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:50.598808 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.598785    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca" (OuterVolumeSpecName: "service-ca") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 14:59:50.600504 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.600478    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:50.600589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.600528    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp" (OuterVolumeSpecName: "kube-api-access-fpmtp") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "kube-api-access-fpmtp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 14:59:50.600589 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.600579    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "3db99874-6c87-46f7-bc5b-ffe02d7cbc92" (UID: "3db99874-6c87-46f7-bc5b-ffe02d7cbc92"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 14:59:50.699362 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699328    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-oauth-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.699362 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699357    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.699362 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699366    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpmtp\" (UniqueName: \"kubernetes.io/projected/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-kube-api-access-fpmtp\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.699585 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699375    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-console-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.699585 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699384    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-trusted-ca-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:50.699585 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:50.699393    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/3db99874-6c87-46f7-bc5b-ffe02d7cbc92-oauth-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 14:59:51.309537 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.309495    2578 generic.go:356] "Generic (PLEG): container finished" podID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" containerID="7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e" exitCode=0
Jul 09 14:59:51.310030 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.309556    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95cd658b-bzbw8" event={"ID":"3db99874-6c87-46f7-bc5b-ffe02d7cbc92","Type":"ContainerDied","Data":"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"}
Jul 09 14:59:51.310030 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.309621    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f95cd658b-bzbw8" event={"ID":"3db99874-6c87-46f7-bc5b-ffe02d7cbc92","Type":"ContainerDied","Data":"3e2df21f2ea497153392a84d4805f501817da2e785dbb290838af0875a9f53bb"}
Jul 09 14:59:51.310030 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.309566    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f95cd658b-bzbw8"
Jul 09 14:59:51.310030 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.309653    2578 scope.go:117] "RemoveContainer" containerID="7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"
Jul 09 14:59:51.320025 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.319985    2578 scope.go:117] "RemoveContainer" containerID="7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"
Jul 09 14:59:51.320335 ip-10-0-129-1 kubenswrapper[2578]: E0709 14:59:51.320309    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e\": container with ID starting with 7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e not found: ID does not exist" containerID="7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"
Jul 09 14:59:51.320416 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.320345    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e"} err="failed to get container status \"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e\": rpc error: code = NotFound desc = could not find container \"7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e\": container with ID starting with 7aeabd021f3418b88621933bef59bd9fde936435abb88fa001ba56e1c67b6b3e not found: ID does not exist"
Jul 09 14:59:51.334244 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.334218    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:59:51.339639 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:51.339605    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f95cd658b-bzbw8"]
Jul 09 14:59:52.124055 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:52.124016    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" path="/var/lib/kubelet/pods/3db99874-6c87-46f7-bc5b-ffe02d7cbc92/volumes"
Jul 09 14:59:53.319975 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:53.319944    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerID="d2d2bd1ca217a72d657b0a1644ba0e664f969ec1476b56a6061fcebaedd4c4c9" exitCode=0
Jul 09 14:59:53.320385 ip-10-0-129-1 kubenswrapper[2578]: I0709 14:59:53.320030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb" event={"ID":"1b0650cb-5b66-464f-bdc7-05d2e9bc969d","Type":"ContainerDied","Data":"d2d2bd1ca217a72d657b0a1644ba0e664f969ec1476b56a6061fcebaedd4c4c9"}
Jul 09 15:00:00.359008 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:00.358954    2578 generic.go:356] "Generic (PLEG): container finished" podID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerID="4f172acb442ec26b169847e9f3f3a23466b297bf9d1b6725a7e3e752fadb649b" exitCode=0
Jul 09 15:00:00.359366 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:00.359024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb" event={"ID":"1b0650cb-5b66-464f-bdc7-05d2e9bc969d","Type":"ContainerDied","Data":"4f172acb442ec26b169847e9f3f3a23466b297bf9d1b6725a7e3e752fadb649b"}
Jul 09 15:00:01.498221 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.498196    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 15:00:01.598857 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.598828    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nc2cj\" (UniqueName: \"kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj\") pod \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") "
Jul 09 15:00:01.599065 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.598920    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle\") pod \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") "
Jul 09 15:00:01.599065 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.598966    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util\") pod \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\" (UID: \"1b0650cb-5b66-464f-bdc7-05d2e9bc969d\") "
Jul 09 15:00:01.599613 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.599591    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle" (OuterVolumeSpecName: "bundle") pod "1b0650cb-5b66-464f-bdc7-05d2e9bc969d" (UID: "1b0650cb-5b66-464f-bdc7-05d2e9bc969d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:01.601270 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.601235    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj" (OuterVolumeSpecName: "kube-api-access-nc2cj") pod "1b0650cb-5b66-464f-bdc7-05d2e9bc969d" (UID: "1b0650cb-5b66-464f-bdc7-05d2e9bc969d"). InnerVolumeSpecName "kube-api-access-nc2cj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:00:01.603442 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.603417    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util" (OuterVolumeSpecName: "util") pod "1b0650cb-5b66-464f-bdc7-05d2e9bc969d" (UID: "1b0650cb-5b66-464f-bdc7-05d2e9bc969d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:01.699733 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.699646    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:01.699733 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.699671    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:01.699733 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:01.699681    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nc2cj\" (UniqueName: \"kubernetes.io/projected/1b0650cb-5b66-464f-bdc7-05d2e9bc969d-kube-api-access-nc2cj\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:02.373412 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:02.373373    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb" event={"ID":"1b0650cb-5b66-464f-bdc7-05d2e9bc969d","Type":"ContainerDied","Data":"746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408"}
Jul 09 15:00:02.373587 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:02.373464    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="746d9bc81df25fef669c17216fba4d5563ccfbdacc026c967b7777db8e3c7408"
Jul 09 15:00:02.373587 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:02.373391    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675405z2pb"
Jul 09 15:00:05.345832 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:05.345788    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:06.165662 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:06.165624    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:07.364532 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364495    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"]
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364819    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="util"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364829    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="util"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364843    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="extract"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364849    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="extract"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364865    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" containerName="console"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364870    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" containerName="console"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364878    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="pull"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364885    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="pull"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364932    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db99874-6c87-46f7-bc5b-ffe02d7cbc92" containerName="console"
Jul 09 15:00:07.364984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.364940    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b0650cb-5b66-464f-bdc7-05d2e9bc969d" containerName="extract"
Jul 09 15:00:07.394960 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.394930    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"]
Jul 09 15:00:07.395148 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.395057    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.398076 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.398053    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jul 09 15:00:07.398200 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.398055    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v8rdn\""
Jul 09 15:00:07.398200 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.398057    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jul 09 15:00:07.549641 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.549598    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-kube-api-access-6zxks\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.549830 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.549666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.651019 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.650892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-kube-api-access-6zxks\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.651019 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.650959    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.651349 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.651330    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.664561 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.664531    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zxks\" (UniqueName: \"kubernetes.io/projected/5d84c444-bf0b-4527-bd29-8a9d00cd40bf-kube-api-access-6zxks\") pod \"cert-manager-operator-controller-manager-55c444bf86-6r8nb\" (UID: \"5d84c444-bf0b-4527-bd29-8a9d00cd40bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.704522 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.704486    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"
Jul 09 15:00:07.858634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:07.858604    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb"]
Jul 09 15:00:07.861361 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:07.861336    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d84c444_bf0b_4527_bd29_8a9d00cd40bf.slice/crio-d7007b506e4af978c7be817f6aec2d9692f38c3ce29b469d8ced9711cd2532bc WatchSource:0}: Error finding container d7007b506e4af978c7be817f6aec2d9692f38c3ce29b469d8ced9711cd2532bc: Status 404 returned error can't find the container with id d7007b506e4af978c7be817f6aec2d9692f38c3ce29b469d8ced9711cd2532bc
Jul 09 15:00:08.400687 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:08.400656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb" event={"ID":"5d84c444-bf0b-4527-bd29-8a9d00cd40bf","Type":"ContainerStarted","Data":"d7007b506e4af978c7be817f6aec2d9692f38c3ce29b469d8ced9711cd2532bc"}
Jul 09 15:00:08.960165 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:08.960081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:09.261063 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:09.260961    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:10.010362 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.010330    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:00:10.010886 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.010867    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:00:10.022366 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.022348    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jul 09 15:00:10.411128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.411093    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb" event={"ID":"5d84c444-bf0b-4527-bd29-8a9d00cd40bf","Type":"ContainerStarted","Data":"d60a65e9b90658905d8acc1c52613dd9229209fd1d5f7d4f1c8ec8f3f1d05f71"}
Jul 09 15:00:10.435871 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.435799    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-6r8nb" podStartSLOduration=1.355992076 podStartE2EDuration="3.435758461s" totalImagesPullingTime="2.079766385s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:10.43383509 +0000 UTC m=+300.849020165" watchObservedRunningTime="2026-07-09 15:00:10.435758461 +0000 UTC m=+300.850943536"
Jul 09 15:00:10.789185 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.789151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:10.915958 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:10.915920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:11.023136 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.023103    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:11.405175 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.405143    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"]
Jul 09 15:00:11.407764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.407748    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.410431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.410410    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 15:00:11.410560 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.410517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 15:00:11.410674 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.410650    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h4792\""
Jul 09 15:00:11.417603 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.417579    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"]
Jul 09 15:00:11.587905 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.587871    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.588127 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.588041    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r72tx\" (UniqueName: \"kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.588127 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.588073    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.689413 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.689320    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.689413 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.689388    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r72tx\" (UniqueName: \"kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.689413 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.689408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.689807 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.689783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.689807 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.689798    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.701099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.701063    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r72tx\" (UniqueName: \"kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.717973 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.717942    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:11.754857 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.754822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dh2jc"]
Jul 09 15:00:11.757351 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.757328    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:11.760417 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.760252    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 09 15:00:11.760417 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.760379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 09 15:00:11.760615 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.760443    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gftzf\""
Jul 09 15:00:11.776078 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.776009    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dh2jc"]
Jul 09 15:00:11.859933 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.859908    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"]
Jul 09 15:00:11.862589 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:11.862561    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb202d6ea_181c_465a_b39f_4561a1feb7a7.slice/crio-7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220 WatchSource:0}: Error finding container 7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220: Status 404 returned error can't find the container with id 7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220
Jul 09 15:00:11.891297 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.891268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:11.891444 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.891324    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67hch\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-kube-api-access-67hch\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:11.992300 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.992261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:11.992479 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:11.992325    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67hch\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-kube-api-access-67hch\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:12.005008 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.004972    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:12.005278 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.005257    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67hch\" (UniqueName: \"kubernetes.io/projected/376eb118-5713-4ca5-b0e9-65e34d3977dd-kube-api-access-67hch\") pod \"cert-manager-webhook-6486ffd997-dh2jc\" (UID: \"376eb118-5713-4ca5-b0e9-65e34d3977dd\") " pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:12.081259 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.081225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:12.218453 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.218423    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-dh2jc"]
Jul 09 15:00:12.220697 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:12.220670    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod376eb118_5713_4ca5_b0e9_65e34d3977dd.slice/crio-e96a325ece5017880f5727dcbe5572e5ac10debb5f5c992d61ff9241c981a2a2 WatchSource:0}: Error finding container e96a325ece5017880f5727dcbe5572e5ac10debb5f5c992d61ff9241c981a2a2: Status 404 returned error can't find the container with id e96a325ece5017880f5727dcbe5572e5ac10debb5f5c992d61ff9241c981a2a2
Jul 09 15:00:12.222887 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.222872    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:00:12.421899 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.421860    2578 generic.go:356] "Generic (PLEG): container finished" podID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerID="a6fd248f172909fb4b1a8c0814d8f20c906a21d5a38dc876cb40ca304da93e93" exitCode=0
Jul 09 15:00:12.422092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.421953    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs" event={"ID":"b202d6ea-181c-465a-b39f-4561a1feb7a7","Type":"ContainerDied","Data":"a6fd248f172909fb4b1a8c0814d8f20c906a21d5a38dc876cb40ca304da93e93"}
Jul 09 15:00:12.422092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.422031    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs" event={"ID":"b202d6ea-181c-465a-b39f-4561a1feb7a7","Type":"ContainerStarted","Data":"7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220"}
Jul 09 15:00:12.423255 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.423218    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc" event={"ID":"376eb118-5713-4ca5-b0e9-65e34d3977dd","Type":"ContainerStarted","Data":"e96a325ece5017880f5727dcbe5572e5ac10debb5f5c992d61ff9241c981a2a2"}
Jul 09 15:00:12.993929 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:12.993835    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:13.374427 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:13.374327    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:15.440191 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:15.440151    2578 generic.go:356] "Generic (PLEG): container finished" podID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerID="865600c78a0971123e7df57bc9e734805e7e353351a85163ef5380f354af41f9" exitCode=0
Jul 09 15:00:15.440699 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:15.440232    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs" event={"ID":"b202d6ea-181c-465a-b39f-4561a1feb7a7","Type":"ContainerDied","Data":"865600c78a0971123e7df57bc9e734805e7e353351a85163ef5380f354af41f9"}
Jul 09 15:00:15.751583 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:15.751548    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:15.827498 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:15.827466    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:16.446023 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:16.445928    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc" event={"ID":"376eb118-5713-4ca5-b0e9-65e34d3977dd","Type":"ContainerStarted","Data":"f12820e79a1f34be925a9ba64f0e135a17f6e466a9e8ad75c81021b46676ca8c"}
Jul 09 15:00:16.446023 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:16.446018    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:16.448054 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:16.448029    2578 generic.go:356] "Generic (PLEG): container finished" podID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerID="f30a4bf5b76a9d034e722767b42bf2ddbc85a74559894a4ce39db165784bb9df" exitCode=0
Jul 09 15:00:16.448168 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:16.448067    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs" event={"ID":"b202d6ea-181c-465a-b39f-4561a1feb7a7","Type":"ContainerDied","Data":"f30a4bf5b76a9d034e722767b42bf2ddbc85a74559894a4ce39db165784bb9df"}
Jul 09 15:00:16.480809 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:16.480764    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc" podStartSLOduration=1.7591512759999999 podStartE2EDuration="5.480749256s" totalImagesPullingTime="3.72159798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:16.478379433 +0000 UTC m=+306.893564509" watchObservedRunningTime="2026-07-09 15:00:16.480749256 +0000 UTC m=+306.895934331"
Jul 09 15:00:17.582180 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.582145    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:17.744918 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.744830    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r72tx\" (UniqueName: \"kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx\") pod \"b202d6ea-181c-465a-b39f-4561a1feb7a7\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") "
Jul 09 15:00:17.744918 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.744878    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle\") pod \"b202d6ea-181c-465a-b39f-4561a1feb7a7\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") "
Jul 09 15:00:17.745189 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.744937    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util\") pod \"b202d6ea-181c-465a-b39f-4561a1feb7a7\" (UID: \"b202d6ea-181c-465a-b39f-4561a1feb7a7\") "
Jul 09 15:00:17.745322 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.745290    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle" (OuterVolumeSpecName: "bundle") pod "b202d6ea-181c-465a-b39f-4561a1feb7a7" (UID: "b202d6ea-181c-465a-b39f-4561a1feb7a7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:17.747192 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.747169    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx" (OuterVolumeSpecName: "kube-api-access-r72tx") pod "b202d6ea-181c-465a-b39f-4561a1feb7a7" (UID: "b202d6ea-181c-465a-b39f-4561a1feb7a7"). InnerVolumeSpecName "kube-api-access-r72tx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:00:17.749348 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.749315    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util" (OuterVolumeSpecName: "util") pod "b202d6ea-181c-465a-b39f-4561a1feb7a7" (UID: "b202d6ea-181c-465a-b39f-4561a1feb7a7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:17.846248 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.846207    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:17.846248 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.846241    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b202d6ea-181c-465a-b39f-4561a1feb7a7-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:17.846248 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.846250    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r72tx\" (UniqueName: \"kubernetes.io/projected/b202d6ea-181c-465a-b39f-4561a1feb7a7-kube-api-access-r72tx\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:17.973907 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:17.973871    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:18.058567 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:18.058495    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:18.459037 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:18.459011    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs"
Jul 09 15:00:18.459212 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:18.459017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fgjxcs" event={"ID":"b202d6ea-181c-465a-b39f-4561a1feb7a7","Type":"ContainerDied","Data":"7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220"}
Jul 09 15:00:18.459212 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:18.459131    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7cbe7fdb8bd6e6bb29e55d51747802b22aac05f1c173c9ffac9c267c625c6220"
Jul 09 15:00:20.034356 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:20.034312    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:20.133095 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:20.133054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:21.009648 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.009607    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:21.553705 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.553670    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nh5sm"]
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.553980    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="extract"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554005    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="extract"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554023    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="util"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554028    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="util"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554033    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="pull"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554041    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="pull"
Jul 09 15:00:21.554129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.554099    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b202d6ea-181c-465a-b39f-4561a1feb7a7" containerName="extract"
Jul 09 15:00:21.556144 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.556128    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.559040 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.559021    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-hs56j\""
Jul 09 15:00:21.570317 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.570284    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nh5sm"]
Jul 09 15:00:21.676358 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.676326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.676542 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.676460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtdkn\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-kube-api-access-dtdkn\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.777039 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.776986    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtdkn\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-kube-api-access-dtdkn\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.777039 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.777046    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.788222 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.788192    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtdkn\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-kube-api-access-dtdkn\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.789090 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.789070    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ae333804-652b-48c5-ad80-91ad0d652a48-bound-sa-token\") pod \"cert-manager-55b4d954d5-nh5sm\" (UID: \"ae333804-652b-48c5-ad80-91ad0d652a48\") " pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:21.864743 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:21.864654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-nh5sm"
Jul 09 15:00:22.006977 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.006948    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-nh5sm"]
Jul 09 15:00:22.009409 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:22.009378    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae333804_652b_48c5_ad80_91ad0d652a48.slice/crio-b55f504f4039356d928adf7e1df844d077ec365edd58e7cb9fa36b26966075bb WatchSource:0}: Error finding container b55f504f4039356d928adf7e1df844d077ec365edd58e7cb9fa36b26966075bb: Status 404 returned error can't find the container with id b55f504f4039356d928adf7e1df844d077ec365edd58e7cb9fa36b26966075bb
Jul 09 15:00:22.166256 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.166165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:22.272038 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.271973    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:22.454856 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.454825    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-dh2jc"
Jul 09 15:00:22.478066 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.478027    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nh5sm" event={"ID":"ae333804-652b-48c5-ad80-91ad0d652a48","Type":"ContainerStarted","Data":"76cd015dfeec103c09f884b3ed8de6161a5a7d1150f071a206a9eab4c0157cbd"}
Jul 09 15:00:22.478227 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.478078    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-nh5sm" event={"ID":"ae333804-652b-48c5-ad80-91ad0d652a48","Type":"ContainerStarted","Data":"b55f504f4039356d928adf7e1df844d077ec365edd58e7cb9fa36b26966075bb"}
Jul 09 15:00:22.498178 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:22.498129    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-nh5sm" podStartSLOduration=1.498110801 podStartE2EDuration="1.498110801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:22.496885178 +0000 UTC m=+312.912070255" watchObservedRunningTime="2026-07-09 15:00:22.498110801 +0000 UTC m=+312.913295873"
Jul 09 15:00:23.720399 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:23.720356    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:23.792191 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:23.792153    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:29.334371 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:29.334333    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:29.434589 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:29.434546    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:31.014236 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.014193    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:31.459419 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.459386    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"]
Jul 09 15:00:31.462251 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.462236    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.465053 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.465028    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 09 15:00:31.465167 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.465129    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 09 15:00:31.465225 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.465172    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-h4792\""
Jul 09 15:00:31.471951 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.471925    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"]
Jul 09 15:00:31.558594 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.558559    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.558771 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.558620    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gp9jw\" (UniqueName: \"kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.558771 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.558678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.659972 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.659936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.660130 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.660001    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.660130 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.660051    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gp9jw\" (UniqueName: \"kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.660320 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.660300    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.660361 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.660332    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.669271 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.669243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gp9jw\" (UniqueName: \"kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.772929 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.772845    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:31.909312 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:31.909286    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"]
Jul 09 15:00:31.911816 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:31.911784    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e6e8bf8_67e0_488a_b740_7a377d1e3d64.slice/crio-99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d WatchSource:0}: Error finding container 99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d: Status 404 returned error can't find the container with id 99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d
Jul 09 15:00:32.529545 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:32.529508    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerID="8dfa6d708105a5bcd77bfe1df00f116df3406deb8acc7476fdb7aba1b3d16959" exitCode=0
Jul 09 15:00:32.529921 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:32.529584    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f" event={"ID":"2e6e8bf8-67e0-488a-b740-7a377d1e3d64","Type":"ContainerDied","Data":"8dfa6d708105a5bcd77bfe1df00f116df3406deb8acc7476fdb7aba1b3d16959"}
Jul 09 15:00:32.529921 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:32.529624    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f" event={"ID":"2e6e8bf8-67e0-488a-b740-7a377d1e3d64","Type":"ContainerStarted","Data":"99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d"}
Jul 09 15:00:33.536286 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:33.536249    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerID="fcc6a92e1229cc0ecf4ab4bc40978a03af298aba12f311515e74400db0f5b632" exitCode=0
Jul 09 15:00:33.536742 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:33.536340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f" event={"ID":"2e6e8bf8-67e0-488a-b740-7a377d1e3d64","Type":"ContainerDied","Data":"fcc6a92e1229cc0ecf4ab4bc40978a03af298aba12f311515e74400db0f5b632"}
Jul 09 15:00:34.543114 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:34.543082    2578 generic.go:356] "Generic (PLEG): container finished" podID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerID="14c570d120bb7010b094a27eded8872277d6fb8f0b3513c2ba5dcc7a4edce65c" exitCode=0
Jul 09 15:00:34.543482 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:34.543163    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f" event={"ID":"2e6e8bf8-67e0-488a-b740-7a377d1e3d64","Type":"ContainerDied","Data":"14c570d120bb7010b094a27eded8872277d6fb8f0b3513c2ba5dcc7a4edce65c"}
Jul 09 15:00:35.685027 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.684972    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:35.796708 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.796669    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle\") pod \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") "
Jul 09 15:00:35.796906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.796715    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util\") pod \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") "
Jul 09 15:00:35.796906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.796763    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gp9jw\" (UniqueName: \"kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw\") pod \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\" (UID: \"2e6e8bf8-67e0-488a-b740-7a377d1e3d64\") "
Jul 09 15:00:35.797556 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.797492    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle" (OuterVolumeSpecName: "bundle") pod "2e6e8bf8-67e0-488a-b740-7a377d1e3d64" (UID: "2e6e8bf8-67e0-488a-b740-7a377d1e3d64"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:35.799057 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.799031    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw" (OuterVolumeSpecName: "kube-api-access-gp9jw") pod "2e6e8bf8-67e0-488a-b740-7a377d1e3d64" (UID: "2e6e8bf8-67e0-488a-b740-7a377d1e3d64"). InnerVolumeSpecName "kube-api-access-gp9jw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:00:35.802712 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.802679    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util" (OuterVolumeSpecName: "util") pod "2e6e8bf8-67e0-488a-b740-7a377d1e3d64" (UID: "2e6e8bf8-67e0-488a-b740-7a377d1e3d64"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:00:35.898187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.898152    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:35.898187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.898180    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:35.898187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:35.898191    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gp9jw\" (UniqueName: \"kubernetes.io/projected/2e6e8bf8-67e0-488a-b740-7a377d1e3d64-kube-api-access-gp9jw\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:00:36.553296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:36.553265    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f"
Jul 09 15:00:36.553296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:36.553288    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afj9t4f" event={"ID":"2e6e8bf8-67e0-488a-b740-7a377d1e3d64","Type":"ContainerDied","Data":"99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d"}
Jul 09 15:00:36.553498 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:36.553335    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="99bb1c59e26c57029ab89b67cc1a2c5fee34a686c58e31df14269723777b1d9d"
Jul 09 15:00:43.381634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:43.381587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:43.477805 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:43.477770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:43.999111 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:43.999064    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.220952 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.220915    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.330493 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.330408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.365451 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365417    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"]
Jul 09 15:00:44.365734 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365722    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="pull"
Jul 09 15:00:44.365773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365735    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="pull"
Jul 09 15:00:44.365773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365756    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="extract"
Jul 09 15:00:44.365773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365761    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="extract"
Jul 09 15:00:44.365773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365771    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="util"
Jul 09 15:00:44.365924 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365777    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="util"
Jul 09 15:00:44.365924 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.365830    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e6e8bf8-67e0-488a-b740-7a377d1e3d64" containerName="extract"
Jul 09 15:00:44.368712 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.368690    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.376573 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.376551    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 09 15:00:44.376686 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.376551    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 09 15:00:44.376686 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.376675    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 09 15:00:44.376898 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.376882    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-p9w5l\""
Jul 09 15:00:44.382750 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.382728    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 09 15:00:44.391425 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.391404    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"]
Jul 09 15:00:44.469964 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.469921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.470140 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.469979    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.470140 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.470102    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.470235 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.470141    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.470235 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.470181    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fx5k\" (UniqueName: \"kubernetes.io/projected/def60588-6b0b-4d08-aa99-271ec9491303-kube-api-access-4fx5k\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.534565 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.534527    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.571287 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571253    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.571443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571295    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.571443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571334    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fx5k\" (UniqueName: \"kubernetes.io/projected/def60588-6b0b-4d08-aa99-271ec9491303-kube-api-access-4fx5k\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.571443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571382    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.571443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571420    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.571870 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.571835    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-manifests\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.573857 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.573836    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/def60588-6b0b-4d08-aa99-271ec9491303-tmp\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.574119 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.574102    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-webhook-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.574190 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.574143    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/def60588-6b0b-4d08-aa99-271ec9491303-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.583523 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.583459    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fx5k\" (UniqueName: \"kubernetes.io/projected/def60588-6b0b-4d08-aa99-271ec9491303-kube-api-access-4fx5k\") pod \"opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk\" (UID: \"def60588-6b0b-4d08-aa99-271ec9491303\") " pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.644984 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.644949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.678710 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.678683    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:44.754324 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.754278    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.819718 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.819697    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"]
Jul 09 15:00:44.822077 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:00:44.822047    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddef60588_6b0b_4d08_aa99_271ec9491303.slice/crio-f8c77bb65b6c1771e9339f1284ea18666fc0558e5fa0e88241b1a3d06caf1d1c WatchSource:0}: Error finding container f8c77bb65b6c1771e9339f1284ea18666fc0558e5fa0e88241b1a3d06caf1d1c: Status 404 returned error can't find the container with id f8c77bb65b6c1771e9339f1284ea18666fc0558e5fa0e88241b1a3d06caf1d1c
Jul 09 15:00:44.826006 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.825964    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:44.928810 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:44.928721    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:45.015190 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:45.015151    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:45.115430 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:45.115390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:45.599517 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:45.599476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk" event={"ID":"def60588-6b0b-4d08-aa99-271ec9491303","Type":"ContainerStarted","Data":"f8c77bb65b6c1771e9339f1284ea18666fc0558e5fa0e88241b1a3d06caf1d1c"}
Jul 09 15:00:48.617601 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:48.617565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk" event={"ID":"def60588-6b0b-4d08-aa99-271ec9491303","Type":"ContainerStarted","Data":"cd09767ba2ea8cce50201c234cb35d2e2e427f254577002ea9213a6f179c16f7"}
Jul 09 15:00:49.313519 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:49.313492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:49.404374 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:49.404341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:00:49.624017 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:49.623916    2578 generic.go:356] "Generic (PLEG): container finished" podID="def60588-6b0b-4d08-aa99-271ec9491303" containerID="cd09767ba2ea8cce50201c234cb35d2e2e427f254577002ea9213a6f179c16f7" exitCode=0
Jul 09 15:00:49.624380 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:49.624021    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk" event={"ID":"def60588-6b0b-4d08-aa99-271ec9491303","Type":"ContainerDied","Data":"cd09767ba2ea8cce50201c234cb35d2e2e427f254577002ea9213a6f179c16f7"}
Jul 09 15:00:50.632070 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:50.632024    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk" event={"ID":"def60588-6b0b-4d08-aa99-271ec9491303","Type":"ContainerStarted","Data":"0509c4a987956acda9ff5552c04f96b503a06cc62050776b76fb94eec95597e5"}
Jul 09 15:00:50.632493 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:50.632122    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:00:50.671592 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:00:50.671538    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk" podStartSLOduration=1.9812623440000001 podStartE2EDuration="6.671520521s" totalImagesPullingTime="3.709372284s" totalInitContainerRuntime="980.885893ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:00:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:00:50.668537384 +0000 UTC m=+341.083722459" watchObservedRunningTime="2026-07-09 15:00:50.671520521 +0000 UTC m=+341.086705598"
Jul 09 15:01:01.639182 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:01.639097    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk"
Jul 09 15:01:03.494374 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:03.494337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:03.604056 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:03.604021    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:03.924217 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:03.924129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:04.124307 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.124280    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"]
Jul 09 15:01:04.127826 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.127807    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.130635 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.130612    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 09 15:01:04.131842 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.131822    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 09 15:01:04.131942 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.131839    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-h4gmk\""
Jul 09 15:01:04.131942 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.131852    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 09 15:01:04.131942 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.131903    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 09 15:01:04.132156 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.132143    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 09 15:01:04.138498 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.138479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"]
Jul 09 15:01:04.160210 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.160180    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:04.253456 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.253408    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.253634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.253528    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.253634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.253577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9q2q\" (UniqueName: \"kubernetes.io/projected/cf79891a-f608-45aa-80eb-8bb0d5def556-kube-api-access-b9q2q\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.253634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.253612    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf79891a-f608-45aa-80eb-8bb0d5def556-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.354771 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.354727    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.354965 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.354787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9q2q\" (UniqueName: \"kubernetes.io/projected/cf79891a-f608-45aa-80eb-8bb0d5def556-kube-api-access-b9q2q\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.354965 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.354827    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf79891a-f608-45aa-80eb-8bb0d5def556-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.354965 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.354898    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.355786 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.355760    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cf79891a-f608-45aa-80eb-8bb0d5def556-manager-config\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.357599 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.357569    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:04.358177 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.358152    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.358515 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.358491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf79891a-f608-45aa-80eb-8bb0d5def556-metrics-cert\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.375727 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.375695    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9q2q\" (UniqueName: \"kubernetes.io/projected/cf79891a-f608-45aa-80eb-8bb0d5def556-kube-api-access-b9q2q\") pod \"lws-controller-manager-6c4bdcff7c-nrl8g\" (UID: \"cf79891a-f608-45aa-80eb-8bb0d5def556\") " pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.439129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.439096    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:04.451327 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.451294    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:04.554850 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.554814    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:04.586927 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.586903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"]
Jul 09 15:01:04.589589 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:01:04.589560    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf79891a_f608_45aa_80eb_8bb0d5def556.slice/crio-b559929670b5b0a92ad7505c8003edc19c7d8b6a43141d11158e95a9297d8bb5 WatchSource:0}: Error finding container b559929670b5b0a92ad7505c8003edc19c7d8b6a43141d11158e95a9297d8bb5: Status 404 returned error can't find the container with id b559929670b5b0a92ad7505c8003edc19c7d8b6a43141d11158e95a9297d8bb5
Jul 09 15:01:04.701065 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.701016    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g" event={"ID":"cf79891a-f608-45aa-80eb-8bb0d5def556","Type":"ContainerStarted","Data":"b559929670b5b0a92ad7505c8003edc19c7d8b6a43141d11158e95a9297d8bb5"}
Jul 09 15:01:04.826767 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:04.826676    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:05.290099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:05.290066    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:05.467127 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:05.467093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:05.544828 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:05.544744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:05.642393 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:05.642361    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:06.716060 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:06.716019    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:07.717977 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:07.717944    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g" event={"ID":"cf79891a-f608-45aa-80eb-8bb0d5def556","Type":"ContainerStarted","Data":"6251f0f9d6a874fefb62afd954c329217895c6fbd484f0769cac97a30995ad33"}
Jul 09 15:01:07.718462 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:07.718073    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:07.735864 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:07.735810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g" podStartSLOduration=1.427120061 podStartE2EDuration="3.735790637s" totalImagesPullingTime="2.308670576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:07.73537015 +0000 UTC m=+358.150555227" watchObservedRunningTime="2026-07-09 15:01:07.735790637 +0000 UTC m=+358.150975903"
Jul 09 15:01:11.566147 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.566115    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"]
Jul 09 15:01:11.570406 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.570384    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.573291 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573264    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 09 15:01:11.573440 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573294    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 09 15:01:11.573440 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573330    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 09 15:01:11.573440 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573388    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 09 15:01:11.573651 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573637    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 09 15:01:11.573723 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573636    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 09 15:01:11.573723 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.573641    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-whkfl\""
Jul 09 15:01:11.583716 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.583695    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"]
Jul 09 15:01:11.622233 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622382 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njmlc\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-kube-api-access-njmlc\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622382 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622382 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622311    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622382 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622351    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622511 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.622511 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.622422    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.723785 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723758    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.723785 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723788    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723831    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njmlc\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-kube-api-access-njmlc\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.723916    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.724748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.724714    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.726353 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.726323    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.726486 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.726419    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.726774 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.726756    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.726835 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.726758    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.738103 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.738082    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.738918 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.738898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njmlc\" (UniqueName: \"kubernetes.io/projected/99e9f74e-b382-47f0-8ab6-590a12b4d7b5-kube-api-access-njmlc\") pod \"istiod-openshift-gateway-94bb8fbfd-qgff5\" (UID: \"99e9f74e-b382-47f0-8ab6-590a12b4d7b5\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:11.880449 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:11.880369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:12.049133 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:12.049104    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"]
Jul 09 15:01:12.050960 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:01:12.050935    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99e9f74e_b382_47f0_8ab6_590a12b4d7b5.slice/crio-64826077671b8eb8fd5023b24a0985b458f55c0ae93fae58829e0db999154b68 WatchSource:0}: Error finding container 64826077671b8eb8fd5023b24a0985b458f55c0ae93fae58829e0db999154b68: Status 404 returned error can't find the container with id 64826077671b8eb8fd5023b24a0985b458f55c0ae93fae58829e0db999154b68
Jul 09 15:01:12.746212 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:12.746181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5" event={"ID":"99e9f74e-b382-47f0-8ab6-590a12b4d7b5","Type":"ContainerStarted","Data":"64826077671b8eb8fd5023b24a0985b458f55c0ae93fae58829e0db999154b68"}
Jul 09 15:01:13.631473 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:13.631434    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:14.083939 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.083904    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 09 15:01:14.084206 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.083970    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892148Ki","pods":"250"}
Jul 09 15:01:14.702588 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.702390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:14.757597 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.757563    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5" event={"ID":"99e9f74e-b382-47f0-8ab6-590a12b4d7b5","Type":"ContainerStarted","Data":"4bb336a301cf6cfd07fd26d47289b57db08622ca2edb33194a957fe7cd1656e0"}
Jul 09 15:01:14.757789 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.757716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:14.802058 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.801980    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5" podStartSLOduration=1.77128795 podStartE2EDuration="3.801961713s" totalImagesPullingTime="2.030673763s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:01:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:01:14.799450104 +0000 UTC m=+365.214635179" watchObservedRunningTime="2026-07-09 15:01:14.801961713 +0000 UTC m=+365.217146790"
Jul 09 15:01:14.806949 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.806916    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:14.935685 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:14.935638    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:15.087411 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:15.087326    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:15.226773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:15.226737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:15.764741 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:15.764716    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-qgff5"
Jul 09 15:01:16.149274 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:16.149197    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:16.248249 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:16.248215    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:16.309281 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:16.309249    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:18.725328 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:18.725294    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6c4bdcff7c-nrl8g"
Jul 09 15:01:35.162434 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:35.162397    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:35.259761 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:35.259728    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:37.670906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:37.670869    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:49.320459 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:49.320415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:49.422181 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:49.422144    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:51.261711 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:51.261674    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:01:51.363065 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:01:51.363028    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:04.976103 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:04.976043    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:05.349123 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:05.349033    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:05.448419 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:05.448373    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:20.126660 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.126625    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"]
Jul 09 15:02:20.129621 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.129606    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.132552 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.132531    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 15:02:20.132683 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.132560    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 15:02:20.133670 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.133654    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tnv95\""
Jul 09 15:02:20.140023 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.140002    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"]
Jul 09 15:02:20.194919 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.194879    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.195102 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.194921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kv7sr\" (UniqueName: \"kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.195102 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.194949    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.296274 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.296236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.296274 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.296273    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kv7sr\" (UniqueName: \"kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.296507 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.296293    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.297060 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.297031    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.297206 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.297076    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.306923 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.306896    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kv7sr\" (UniqueName: \"kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.439247 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.439170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:20.571399 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.571359    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"]
Jul 09 15:02:20.573827 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:02:20.573802    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod622361bd_f492_4515_910c_2f070348acc9.slice/crio-ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8 WatchSource:0}: Error finding container ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8: Status 404 returned error can't find the container with id ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8
Jul 09 15:02:20.720609 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.720579    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"]
Jul 09 15:02:20.723541 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.723525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.733315 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.733293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"]
Jul 09 15:02:20.802752 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.802723    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.802878 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.802796    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc2j6\" (UniqueName: \"kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.802946 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.802916    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.904160 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.904131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc2j6\" (UniqueName: \"kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.904316 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.904212    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.904316 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.904241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.904647 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.904627    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.904715 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.904650    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:20.916446 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:20.916415    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc2j6\" (UniqueName: \"kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:21.047869 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.047786    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:21.084095 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.084062    2578 generic.go:356] "Generic (PLEG): container finished" podID="622361bd-f492-4515-910c-2f070348acc9" containerID="af53233d2a4fb4506facfefb7158099c8d03f37aae410ca926ca329b0cf893fa" exitCode=0
Jul 09 15:02:21.084251 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.084114    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx" event={"ID":"622361bd-f492-4515-910c-2f070348acc9","Type":"ContainerDied","Data":"af53233d2a4fb4506facfefb7158099c8d03f37aae410ca926ca329b0cf893fa"}
Jul 09 15:02:21.084251 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.084152    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx" event={"ID":"622361bd-f492-4515-910c-2f070348acc9","Type":"ContainerStarted","Data":"ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8"}
Jul 09 15:02:21.184886 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.184854    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"]
Jul 09 15:02:21.186930 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:02:21.186899    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded16122f_7a14_416d_8b16_1c4c232e6a09.slice/crio-58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7 WatchSource:0}: Error finding container 58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7: Status 404 returned error can't find the container with id 58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7
Jul 09 15:02:21.327375 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.327309    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"]
Jul 09 15:02:21.330086 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.330062    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.342359 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.342332    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"]
Jul 09 15:02:21.408618 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.408593    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.408739 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.408647    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.408739 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.408664    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zdsl\" (UniqueName: \"kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.509876 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.509844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.510048 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.509899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.510048 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.509924    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zdsl\" (UniqueName: \"kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.510292 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.510270    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.510332 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.510293    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.519513 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.519491    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zdsl\" (UniqueName: \"kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.656652 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.656571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:21.719596 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.719566    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"]
Jul 09 15:02:21.723210 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.723190    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.731722 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.731699    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"]
Jul 09 15:02:21.799463 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.799424    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"]
Jul 09 15:02:21.801477 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:02:21.801455    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa4e75fb_b96a_4df0_a6be_cecedb9f8813.slice/crio-e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990 WatchSource:0}: Error finding container e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990: Status 404 returned error can't find the container with id e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990
Jul 09 15:02:21.812127 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.812106    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sncg6\" (UniqueName: \"kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.812226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.812144    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.812226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.812200    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.913439 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.913383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.913546 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.913451    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.913546 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.913513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sncg6\" (UniqueName: \"kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.913728 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.913705    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.913798 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.913779    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:21.923018 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:21.922978    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sncg6\" (UniqueName: \"kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:22.034880 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.034851    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:22.093051 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.093012    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerID="5d7dfbbafa37c63b5fcad8643cf0547bab63c29c79fb0ed399def20d048cb429" exitCode=0
Jul 09 15:02:22.093187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.093094    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s" event={"ID":"ed16122f-7a14-416d-8b16-1c4c232e6a09","Type":"ContainerDied","Data":"5d7dfbbafa37c63b5fcad8643cf0547bab63c29c79fb0ed399def20d048cb429"}
Jul 09 15:02:22.093187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.093160    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s" event={"ID":"ed16122f-7a14-416d-8b16-1c4c232e6a09","Type":"ContainerStarted","Data":"58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7"}
Jul 09 15:02:22.095019 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.094977    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerID="b66579cc45d77bd546d70bffdb6066a7d4c824c7b5f18586553780066f8a6a3b" exitCode=0
Jul 09 15:02:22.095149 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.095039    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j" event={"ID":"fa4e75fb-b96a-4df0-a6be-cecedb9f8813","Type":"ContainerDied","Data":"b66579cc45d77bd546d70bffdb6066a7d4c824c7b5f18586553780066f8a6a3b"}
Jul 09 15:02:22.095149 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.095099    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j" event={"ID":"fa4e75fb-b96a-4df0-a6be-cecedb9f8813","Type":"ContainerStarted","Data":"e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990"}
Jul 09 15:02:22.097239 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.097202    2578 generic.go:356] "Generic (PLEG): container finished" podID="622361bd-f492-4515-910c-2f070348acc9" containerID="58e14184052629ba5204298ff4b4ff2e089783878ed6af1b68656e5416b899ad" exitCode=0
Jul 09 15:02:22.097351 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.097256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx" event={"ID":"622361bd-f492-4515-910c-2f070348acc9","Type":"ContainerDied","Data":"58e14184052629ba5204298ff4b4ff2e089783878ed6af1b68656e5416b899ad"}
Jul 09 15:02:22.175295 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:22.175269    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"]
Jul 09 15:02:22.177309 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:02:22.177285    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f3b5dc_cf9f_49ef_bc01_108f2649e729.slice/crio-9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68 WatchSource:0}: Error finding container 9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68: Status 404 returned error can't find the container with id 9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68
Jul 09 15:02:23.103468 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.103433    2578 generic.go:356] "Generic (PLEG): container finished" podID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerID="e49582c9e482f5dc095c23604c7235943e2e6997408ceec6833802119590a04f" exitCode=0
Jul 09 15:02:23.103821 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.103477    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn" event={"ID":"16f3b5dc-cf9f-49ef-bc01-108f2649e729","Type":"ContainerDied","Data":"e49582c9e482f5dc095c23604c7235943e2e6997408ceec6833802119590a04f"}
Jul 09 15:02:23.103821 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.103553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn" event={"ID":"16f3b5dc-cf9f-49ef-bc01-108f2649e729","Type":"ContainerStarted","Data":"9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68"}
Jul 09 15:02:23.105870 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.105851    2578 generic.go:356] "Generic (PLEG): container finished" podID="622361bd-f492-4515-910c-2f070348acc9" containerID="dd0bbe6ed6ba772affeff1a92b7bd67b1b3bf782b758dcc2bb0bbabbf8f90ce8" exitCode=0
Jul 09 15:02:23.105948 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.105898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx" event={"ID":"622361bd-f492-4515-910c-2f070348acc9","Type":"ContainerDied","Data":"dd0bbe6ed6ba772affeff1a92b7bd67b1b3bf782b758dcc2bb0bbabbf8f90ce8"}
Jul 09 15:02:23.107788 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.107758    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerID="36c8d6e1ed9b43a17595e410f74fbaeb8db21d7d0051e3b49474b6546f96b4ac" exitCode=0
Jul 09 15:02:23.107893 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.107793    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s" event={"ID":"ed16122f-7a14-416d-8b16-1c4c232e6a09","Type":"ContainerDied","Data":"36c8d6e1ed9b43a17595e410f74fbaeb8db21d7d0051e3b49474b6546f96b4ac"}
Jul 09 15:02:23.109717 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.109696    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerID="f4f05ff28f01d1f5b54855c2a05839e7e2f3a9a004db993134c781e8a10373bb" exitCode=0
Jul 09 15:02:23.109813 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:23.109750    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j" event={"ID":"fa4e75fb-b96a-4df0-a6be-cecedb9f8813","Type":"ContainerDied","Data":"f4f05ff28f01d1f5b54855c2a05839e7e2f3a9a004db993134c781e8a10373bb"}
Jul 09 15:02:24.117226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.117191    2578 generic.go:356] "Generic (PLEG): container finished" podID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerID="e7422a1b2fe4d4a55b006917ba667b134654d927b92016baed2800a9e719f0ae" exitCode=0
Jul 09 15:02:24.117687 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.117280    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s" event={"ID":"ed16122f-7a14-416d-8b16-1c4c232e6a09","Type":"ContainerDied","Data":"e7422a1b2fe4d4a55b006917ba667b134654d927b92016baed2800a9e719f0ae"}
Jul 09 15:02:24.119450 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.119428    2578 generic.go:356] "Generic (PLEG): container finished" podID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerID="95bee98e8a958e2fc3a055d1622757a7d44e6ab123c7ecc5e8cf9dc2cbdc3530" exitCode=0
Jul 09 15:02:24.123914 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.123886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j" event={"ID":"fa4e75fb-b96a-4df0-a6be-cecedb9f8813","Type":"ContainerDied","Data":"95bee98e8a958e2fc3a055d1622757a7d44e6ab123c7ecc5e8cf9dc2cbdc3530"}
Jul 09 15:02:24.253356 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.253335    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:24.336560 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.336529    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util\") pod \"622361bd-f492-4515-910c-2f070348acc9\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") "
Jul 09 15:02:24.336725 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.336604    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kv7sr\" (UniqueName: \"kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr\") pod \"622361bd-f492-4515-910c-2f070348acc9\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") "
Jul 09 15:02:24.336725 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.336643    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle\") pod \"622361bd-f492-4515-910c-2f070348acc9\" (UID: \"622361bd-f492-4515-910c-2f070348acc9\") "
Jul 09 15:02:24.337311 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.337281    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle" (OuterVolumeSpecName: "bundle") pod "622361bd-f492-4515-910c-2f070348acc9" (UID: "622361bd-f492-4515-910c-2f070348acc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:24.338978 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.338948    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr" (OuterVolumeSpecName: "kube-api-access-kv7sr") pod "622361bd-f492-4515-910c-2f070348acc9" (UID: "622361bd-f492-4515-910c-2f070348acc9"). InnerVolumeSpecName "kube-api-access-kv7sr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:24.342193 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.342171    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util" (OuterVolumeSpecName: "util") pod "622361bd-f492-4515-910c-2f070348acc9" (UID: "622361bd-f492-4515-910c-2f070348acc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:24.437431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.437355    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kv7sr\" (UniqueName: \"kubernetes.io/projected/622361bd-f492-4515-910c-2f070348acc9-kube-api-access-kv7sr\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:24.437431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.437384    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:24.437431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:24.437393    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/622361bd-f492-4515-910c-2f070348acc9-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.128969 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.128942    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx"
Jul 09 15:02:25.129344 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.129005    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx" event={"ID":"622361bd-f492-4515-910c-2f070348acc9","Type":"ContainerDied","Data":"ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8"}
Jul 09 15:02:25.129344 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.129056    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff46ac4ee0742e2183fd61f9477184b44cd534ae870d492924dc9f634a1295c8"
Jul 09 15:02:25.270746 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.270718    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:25.301842 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.301816    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:25.345352 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345324    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util\") pod \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") "
Jul 09 15:02:25.345502 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345425    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4zdsl\" (UniqueName: \"kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl\") pod \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") "
Jul 09 15:02:25.345502 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345463    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle\") pod \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\" (UID: \"fa4e75fb-b96a-4df0-a6be-cecedb9f8813\") "
Jul 09 15:02:25.345502 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345499    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util\") pod \"ed16122f-7a14-416d-8b16-1c4c232e6a09\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") "
Jul 09 15:02:25.345669 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345525    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gc2j6\" (UniqueName: \"kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6\") pod \"ed16122f-7a14-416d-8b16-1c4c232e6a09\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") "
Jul 09 15:02:25.345669 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.345548    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle\") pod \"ed16122f-7a14-416d-8b16-1c4c232e6a09\" (UID: \"ed16122f-7a14-416d-8b16-1c4c232e6a09\") "
Jul 09 15:02:25.346162 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.346133    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle" (OuterVolumeSpecName: "bundle") pod "fa4e75fb-b96a-4df0-a6be-cecedb9f8813" (UID: "fa4e75fb-b96a-4df0-a6be-cecedb9f8813"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:25.346541 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.346502    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle" (OuterVolumeSpecName: "bundle") pod "ed16122f-7a14-416d-8b16-1c4c232e6a09" (UID: "ed16122f-7a14-416d-8b16-1c4c232e6a09"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:25.347940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.347912    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl" (OuterVolumeSpecName: "kube-api-access-4zdsl") pod "fa4e75fb-b96a-4df0-a6be-cecedb9f8813" (UID: "fa4e75fb-b96a-4df0-a6be-cecedb9f8813"). InnerVolumeSpecName "kube-api-access-4zdsl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:25.348072 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.348024    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6" (OuterVolumeSpecName: "kube-api-access-gc2j6") pod "ed16122f-7a14-416d-8b16-1c4c232e6a09" (UID: "ed16122f-7a14-416d-8b16-1c4c232e6a09"). InnerVolumeSpecName "kube-api-access-gc2j6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:25.351674 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.351649    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util" (OuterVolumeSpecName: "util") pod "ed16122f-7a14-416d-8b16-1c4c232e6a09" (UID: "ed16122f-7a14-416d-8b16-1c4c232e6a09"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:25.352720 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.352699    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util" (OuterVolumeSpecName: "util") pod "fa4e75fb-b96a-4df0-a6be-cecedb9f8813" (UID: "fa4e75fb-b96a-4df0-a6be-cecedb9f8813"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446484    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4zdsl\" (UniqueName: \"kubernetes.io/projected/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-kube-api-access-4zdsl\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446512    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446521    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446529    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gc2j6\" (UniqueName: \"kubernetes.io/projected/ed16122f-7a14-416d-8b16-1c4c232e6a09-kube-api-access-gc2j6\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446538    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed16122f-7a14-416d-8b16-1c4c232e6a09-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:25.446550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:25.446547    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fa4e75fb-b96a-4df0-a6be-cecedb9f8813-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:26.140773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.140745    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s" event={"ID":"ed16122f-7a14-416d-8b16-1c4c232e6a09","Type":"ContainerDied","Data":"58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7"}
Jul 09 15:02:26.141223 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.140819    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="58c4485065fce04246d0be7b0ef799aef76d50195bdcdbf227e600a4400caac7"
Jul 09 15:02:26.141223 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.140754    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s"
Jul 09 15:02:26.142656 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.142636    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j"
Jul 09 15:02:26.142797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.142680    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j" event={"ID":"fa4e75fb-b96a-4df0-a6be-cecedb9f8813","Type":"ContainerDied","Data":"e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990"}
Jul 09 15:02:26.142797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.142719    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e631b5f3b2189ce5c0b02d433426dec008e0cb7f1e8403d850285d4bfd62a990"
Jul 09 15:02:26.144487 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.144461    2578 generic.go:356] "Generic (PLEG): container finished" podID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerID="51a230dfde183dd9ea657731b069fe8bcb5446bc9fbc0618179f42bf0b45c122" exitCode=0
Jul 09 15:02:26.144623 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:26.144524    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn" event={"ID":"16f3b5dc-cf9f-49ef-bc01-108f2649e729","Type":"ContainerDied","Data":"51a230dfde183dd9ea657731b069fe8bcb5446bc9fbc0618179f42bf0b45c122"}
Jul 09 15:02:27.151557 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:27.151519    2578 generic.go:356] "Generic (PLEG): container finished" podID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerID="33ab0c10f57ce0b8a8d21d7595410d4690148724835507322094448c8521ae28" exitCode=0
Jul 09 15:02:27.151916 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:27.151576    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn" event={"ID":"16f3b5dc-cf9f-49ef-bc01-108f2649e729","Type":"ContainerDied","Data":"33ab0c10f57ce0b8a8d21d7595410d4690148724835507322094448c8521ae28"}
Jul 09 15:02:28.286455 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.286433    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:28.372561 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.372524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle\") pod \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") "
Jul 09 15:02:28.372561 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.372570    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util\") pod \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") "
Jul 09 15:02:28.372828 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.372695    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sncg6\" (UniqueName: \"kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6\") pod \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\" (UID: \"16f3b5dc-cf9f-49ef-bc01-108f2649e729\") "
Jul 09 15:02:28.373129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.373095    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle" (OuterVolumeSpecName: "bundle") pod "16f3b5dc-cf9f-49ef-bc01-108f2649e729" (UID: "16f3b5dc-cf9f-49ef-bc01-108f2649e729"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:28.375280 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.375256    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6" (OuterVolumeSpecName: "kube-api-access-sncg6") pod "16f3b5dc-cf9f-49ef-bc01-108f2649e729" (UID: "16f3b5dc-cf9f-49ef-bc01-108f2649e729"). InnerVolumeSpecName "kube-api-access-sncg6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:02:28.379696 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.379651    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util" (OuterVolumeSpecName: "util") pod "16f3b5dc-cf9f-49ef-bc01-108f2649e729" (UID: "16f3b5dc-cf9f-49ef-bc01-108f2649e729"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 09 15:02:28.473818 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.473776    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sncg6\" (UniqueName: \"kubernetes.io/projected/16f3b5dc-cf9f-49ef-bc01-108f2649e729-kube-api-access-sncg6\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:28.473818 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.473816    2578 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:28.474121 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:28.473831    2578 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/16f3b5dc-cf9f-49ef-bc01-108f2649e729-util\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:02:29.162639 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:29.162599    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn" event={"ID":"16f3b5dc-cf9f-49ef-bc01-108f2649e729","Type":"ContainerDied","Data":"9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68"}
Jul 09 15:02:29.162784 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:29.162659    2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9edc380abc7c404953481efacefabee8a87f3531f96e8fc908a3054b38008c68"
Jul 09 15:02:29.162784 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:29.162615    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn"
Jul 09 15:02:33.480859 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:33.480773    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:37.918057 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:37.918023    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:38.465640 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:38.465603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:38.879699 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:38.879606    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:39.954369 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:39.954331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:40.080832 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:40.080800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:41.444819 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:41.444779    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:41.545785 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:41.545749    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:43.665155 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:43.665124    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:45.531364 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:45.531330    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:47.270894 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:47.270856    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:47.375582 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:47.375545    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:49.497950 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:49.497920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:49.855430 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:49.855342    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:56.468630 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:56.468590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:56.572006 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:56.571965    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:58.997429 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:58.997390    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:02:59.099037 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:02:59.099002    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:04.759151 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:04.759115    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:04.859391 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:04.859343    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:07.477006 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:07.476949    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:07.577253 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:07.577216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:14.088527 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:14.088490    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:16.251589 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:16.251552    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:16.817300 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:16.817265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:18.709356 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:18.709319    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:18.809639 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:18.809608    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:23.492546 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:23.492509    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:23.591078 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:23.591038    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:27.437322 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:27.437292    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:27.556542 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:27.556507    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:37.815079 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:37.815042    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:37.873330 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:37.873297    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:38.225957 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:38.225927    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:38.326232 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:38.326201    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:42.029923 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:42.029874    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:42.129119 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:42.129091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:42.495040 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:42.494979    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:43.103031 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:43.102980    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:44.875059 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:44.875024    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:44.982677 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:44.982641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:46.622799 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.622766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:46.628605 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628580    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:03:46.628898 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628886    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="util"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628900    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="util"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628908    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="util"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628913    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="util"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628923    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="extract"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628929    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="extract"
Jul 09 15:03:46.628940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628940    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="util"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628946    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="util"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628952    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="util"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628957    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="util"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628966    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628971    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628978    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.628984    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629002    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629007    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629016    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629020    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629027    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629032    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="pull"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629038    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629050    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629057    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629062    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629109    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="16f3b5dc-cf9f-49ef-bc01-108f2649e729" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629117    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed16122f-7a14-416d-8b16-1c4c232e6a09" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629126    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa4e75fb-b96a-4df0-a6be-cecedb9f8813" containerName="extract"
Jul 09 15:03:46.629161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.629131    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="622361bd-f492-4515-910c-2f070348acc9" containerName="extract"
Jul 09 15:03:46.631190 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.631175    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.634029 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.634010    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-tnv95\""
Jul 09 15:03:46.634143 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.634066    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 09 15:03:46.634143 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.634086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 09 15:03:46.634978 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.634963    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 09 15:03:46.645202 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.645182    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:03:46.728685 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.728652    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:03:46.734132 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.734109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zt8s\" (UniqueName: \"kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.734243 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.734148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.740932 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.740902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:46.814954 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.814928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:46.834875 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.834842    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zt8s\" (UniqueName: \"kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.835023 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.834892    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.835520 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.835502    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.845963 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.845936    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zt8s\" (UniqueName: \"kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s\") pod \"limitador-limitador-64c94fd64f-r2xtc\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:46.941284 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:46.941211    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:47.077272 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:47.077249    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:03:47.079222 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:03:47.079194    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b97744d_0acf_4881_9661_102048b22350.slice/crio-2cac73d5566325574fabf86a4b91737d047ea8640c93625f8dcba9dbb52eebd2 WatchSource:0}: Error finding container 2cac73d5566325574fabf86a4b91737d047ea8640c93625f8dcba9dbb52eebd2: Status 404 returned error can't find the container with id 2cac73d5566325574fabf86a4b91737d047ea8640c93625f8dcba9dbb52eebd2
Jul 09 15:03:47.523050 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:47.523018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:47.570426 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:47.570394    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" event={"ID":"8b97744d-0acf-4881-9661-102048b22350","Type":"ContainerStarted","Data":"2cac73d5566325574fabf86a4b91737d047ea8640c93625f8dcba9dbb52eebd2"}
Jul 09 15:03:47.615325 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:47.615288    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:03:50.587138 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:50.587106    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" event={"ID":"8b97744d-0acf-4881-9661-102048b22350","Type":"ContainerStarted","Data":"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"}
Jul 09 15:03:50.587547 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:50.587221    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:03:50.607464 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:03:50.607419    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" podStartSLOduration=1.990515142 podStartE2EDuration="4.607406224s" totalImagesPullingTime="2.616891082s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:03:50.606537031 +0000 UTC m=+521.021722109" watchObservedRunningTime="2026-07-09 15:03:50.607406224 +0000 UTC m=+521.022591299"
Jul 09 15:04:01.592731 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:01.592651    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:04:04.651848 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:04.651812    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:04:04.652295 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:04.652028    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" podUID="8b97744d-0acf-4881-9661-102048b22350" containerName="limitador" containerID="cri-o://e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c" gracePeriod=30
Jul 09 15:04:05.195430 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.195407    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:04:05.288854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.288778    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7zt8s\" (UniqueName: \"kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s\") pod \"8b97744d-0acf-4881-9661-102048b22350\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") "
Jul 09 15:04:05.288854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.288812    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file\") pod \"8b97744d-0acf-4881-9661-102048b22350\" (UID: \"8b97744d-0acf-4881-9661-102048b22350\") "
Jul 09 15:04:05.289231 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.289205    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file" (OuterVolumeSpecName: "config-file") pod "8b97744d-0acf-4881-9661-102048b22350" (UID: "8b97744d-0acf-4881-9661-102048b22350"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:04:05.290974 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.290947    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s" (OuterVolumeSpecName: "kube-api-access-7zt8s") pod "8b97744d-0acf-4881-9661-102048b22350" (UID: "8b97744d-0acf-4881-9661-102048b22350"). InnerVolumeSpecName "kube-api-access-7zt8s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:05.390052 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.390023    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7zt8s\" (UniqueName: \"kubernetes.io/projected/8b97744d-0acf-4881-9661-102048b22350-kube-api-access-7zt8s\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:05.390052 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.390046    2578 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/8b97744d-0acf-4881-9661-102048b22350-config-file\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:05.665229 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.665139    2578 generic.go:356] "Generic (PLEG): container finished" podID="8b97744d-0acf-4881-9661-102048b22350" containerID="e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c" exitCode=0
Jul 09 15:04:05.665229 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.665184    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"
Jul 09 15:04:05.665710 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.665223    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" event={"ID":"8b97744d-0acf-4881-9661-102048b22350","Type":"ContainerDied","Data":"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"}
Jul 09 15:04:05.665710 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.665275    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-r2xtc" event={"ID":"8b97744d-0acf-4881-9661-102048b22350","Type":"ContainerDied","Data":"2cac73d5566325574fabf86a4b91737d047ea8640c93625f8dcba9dbb52eebd2"}
Jul 09 15:04:05.665710 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.665302    2578 scope.go:117] "RemoveContainer" containerID="e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"
Jul 09 15:04:05.674957 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.674939    2578 scope.go:117] "RemoveContainer" containerID="e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"
Jul 09 15:04:05.675250 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:04:05.675233    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c\": container with ID starting with e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c not found: ID does not exist" containerID="e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"
Jul 09 15:04:05.675305 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.675257    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c"} err="failed to get container status \"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c\": rpc error: code = NotFound desc = could not find container \"e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c\": container with ID starting with e6a9ceed2d9c127d46e1e692002b30456716897eab1fc58c6680a384b06cd84c not found: ID does not exist"
Jul 09 15:04:05.694482 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.694461    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:04:05.697786 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:05.697759    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-r2xtc"]
Jul 09 15:04:06.123555 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:06.123525    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b97744d-0acf-4881-9661-102048b22350" path="/var/lib/kubelet/pods/8b97744d-0acf-4881-9661-102048b22350/volumes"
Jul 09 15:04:07.930055 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:07.930022    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:08.028225 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.028186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:08.398362 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.398316    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"]
Jul 09 15:04:08.398854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.398828    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b97744d-0acf-4881-9661-102048b22350" containerName="limitador"
Jul 09 15:04:08.398854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.398848    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b97744d-0acf-4881-9661-102048b22350" containerName="limitador"
Jul 09 15:04:08.398968 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.398938    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b97744d-0acf-4881-9661-102048b22350" containerName="limitador"
Jul 09 15:04:08.403722 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.403705    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.407004 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.406965    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 15:04:08.407116 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.407047    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-xr7dl\""
Jul 09 15:04:08.408188 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.408168    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 09 15:04:08.408313 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.408192    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 09 15:04:08.412420 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.412395    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"]
Jul 09 15:04:08.441826 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.441800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:08.514211 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.514182    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr827\" (UniqueName: \"kubernetes.io/projected/8e3163ad-bc54-492a-86da-0fa74df0e216-kube-api-access-dr827\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.514347 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.514245    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8e3163ad-bc54-492a-86da-0fa74df0e216-data\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.615211 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.615185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8e3163ad-bc54-492a-86da-0fa74df0e216-data\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.615336 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.615235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr827\" (UniqueName: \"kubernetes.io/projected/8e3163ad-bc54-492a-86da-0fa74df0e216-kube-api-access-dr827\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.615540 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.615522    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8e3163ad-bc54-492a-86da-0fa74df0e216-data\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.624361 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.624338    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr827\" (UniqueName: \"kubernetes.io/projected/8e3163ad-bc54-492a-86da-0fa74df0e216-kube-api-access-dr827\") pod \"postgres-69fb4594cf-tqqqt\" (UID: \"8e3163ad-bc54-492a-86da-0fa74df0e216\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.716067 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.716045    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:08.853179 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:08.853152    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"]
Jul 09 15:04:08.854505 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:04:08.854476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e3163ad_bc54_492a_86da_0fa74df0e216.slice/crio-69f74e5ca6fba0627b924c89b322776dd5c571186f12c4cb8daba7da5bc4ca8e WatchSource:0}: Error finding container 69f74e5ca6fba0627b924c89b322776dd5c571186f12c4cb8daba7da5bc4ca8e: Status 404 returned error can't find the container with id 69f74e5ca6fba0627b924c89b322776dd5c571186f12c4cb8daba7da5bc4ca8e
Jul 09 15:04:09.689164 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:09.689132    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt" event={"ID":"8e3163ad-bc54-492a-86da-0fa74df0e216","Type":"ContainerStarted","Data":"69f74e5ca6fba0627b924c89b322776dd5c571186f12c4cb8daba7da5bc4ca8e"}
Jul 09 15:04:11.900509 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.900340    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55569d976b-zw8hh"]
Jul 09 15:04:11.920716 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.920265    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55569d976b-zw8hh"]
Jul 09 15:04:11.920716 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.920369    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.950487 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950429    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-trusted-ca-bundle\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950762    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-service-ca\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950849    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-console-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950917    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-oauth-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.950954    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-oauth-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.951128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.951019    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7llf\" (UniqueName: \"kubernetes.io/projected/2eba0a8f-e125-45d3-87db-53738a792556-kube-api-access-t7llf\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:11.953789 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:11.953756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:12.052389 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052351    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-trusted-ca-bundle\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052568 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052408    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-service-ca\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052638 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052570    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-console-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052638 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052621    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052735 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052652    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-oauth-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052735 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052696    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-oauth-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.052845 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.052742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7llf\" (UniqueName: \"kubernetes.io/projected/2eba0a8f-e125-45d3-87db-53738a792556-kube-api-access-t7llf\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.053233 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.053183    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-service-ca\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.053368 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.053240    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-console-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.053368 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.053326    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-trusted-ca-bundle\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.053563 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.053539    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eba0a8f-e125-45d3-87db-53738a792556-oauth-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.055792 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.055768    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-oauth-config\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.055943 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.055926    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eba0a8f-e125-45d3-87db-53738a792556-console-serving-cert\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.061843 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.061822    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7llf\" (UniqueName: \"kubernetes.io/projected/2eba0a8f-e125-45d3-87db-53738a792556-kube-api-access-t7llf\") pod \"console-55569d976b-zw8hh\" (UID: \"2eba0a8f-e125-45d3-87db-53738a792556\") " pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.087383 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.087354    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:12.145653 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.145612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:12.233561 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.233530    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:12.686802 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.686683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:12.744436 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:12.744394    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:13.765162 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:13.765107    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\""
Jul 09 15:04:13.822407 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:13.822385    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55569d976b-zw8hh"]
Jul 09 15:04:13.824290 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:04:13.824260    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eba0a8f_e125_45d3_87db_53738a792556.slice/crio-b4b9eb646655ef155c06361df2134cb8eb921e736af03aa37fb7be8707a9149e WatchSource:0}: Error finding container b4b9eb646655ef155c06361df2134cb8eb921e736af03aa37fb7be8707a9149e: Status 404 returned error can't find the container with id b4b9eb646655ef155c06361df2134cb8eb921e736af03aa37fb7be8707a9149e
Jul 09 15:04:14.720478 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.720441    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55569d976b-zw8hh" event={"ID":"2eba0a8f-e125-45d3-87db-53738a792556","Type":"ContainerStarted","Data":"bb81cde7cea5d4f4e8edb061a97f459405aaebcd706e7abc80f80e72ed234787"}
Jul 09 15:04:14.720677 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.720505    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55569d976b-zw8hh" event={"ID":"2eba0a8f-e125-45d3-87db-53738a792556","Type":"ContainerStarted","Data":"b4b9eb646655ef155c06361df2134cb8eb921e736af03aa37fb7be8707a9149e"}
Jul 09 15:04:14.721981 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.721952    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt" event={"ID":"8e3163ad-bc54-492a-86da-0fa74df0e216","Type":"ContainerStarted","Data":"d275985b2f46111aa08c9db681aa061c23242725fbb25b50ca89fd0daaeb4efc"}
Jul 09 15:04:14.722118 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.722032    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:14.742376 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.742326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55569d976b-zw8hh" podStartSLOduration=3.742306047 podStartE2EDuration="3.742306047s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:14.74084314 +0000 UTC m=+545.156028216" watchObservedRunningTime="2026-07-09 15:04:14.742306047 +0000 UTC m=+545.157491126"
Jul 09 15:04:14.759480 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:14.759436    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt" podStartSLOduration=1.8533197970000002 podStartE2EDuration="6.75942267s" totalImagesPullingTime="4.906102873s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:14.757065515 +0000 UTC m=+545.172250592" watchObservedRunningTime="2026-07-09 15:04:14.75942267 +0000 UTC m=+545.174607746"
Jul 09 15:04:20.758412 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:20.758378    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-tqqqt"
Jul 09 15:04:21.085161 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:21.085079    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:21.186754 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:21.186719    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:22.233676 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.233647    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:22.234078 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.233705    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:22.238517 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.238495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:22.768371 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.768342    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55569d976b-zw8hh"
Jul 09 15:04:22.821701 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.821669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 15:04:22.936588 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.936554    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:22.997023 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:22.996982    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:23.066099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:23.066026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:27.401725 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.401677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:27.418685 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.418653    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:27.443869 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.443844    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:27.444033 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.443937    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.446619 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.446597    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 15:04:27.446746 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.446605    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 15:04:27.446746 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.446622    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xcgw\""
Jul 09 15:04:27.483120 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.483054    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:27.538411 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.538380    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:27.592331 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.592303    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fns8r\" (UniqueName: \"kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.592475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.592362    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.595565 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.595545    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:04:27.598848 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.598832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.610089 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.610068    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:04:27.693091 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.693024    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7zmv\" (UniqueName: \"kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.693091 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.693071    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.693234 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.693095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fns8r\" (UniqueName: \"kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.693234 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.693147    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.693234 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:04:27.693225    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jul 09 15:04:27.693346 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:04:27.693277    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert podName:0f59a125-6434-4f03-831b-c66a0f5114fa nodeName:}" failed. No retries permitted until 2026-07-09 15:04:28.19326277 +0000 UTC m=+558.608447824 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert") pod "maas-controller-85566d4fc9-tjxjp" (UID: "0f59a125-6434-4f03-831b-c66a0f5114fa") : secret "maas-controller-webhook-cert" not found
Jul 09 15:04:27.704805 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.704780    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fns8r\" (UniqueName: \"kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:27.793998 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.793974    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7zmv\" (UniqueName: \"kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.794113 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.794023    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.796466 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.796446    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.803856 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.803838    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7zmv\" (UniqueName: \"kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv\") pod \"maas-controller-848487dc69-nbmvs\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") " pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:27.828751 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.828718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:27.909253 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:27.909232    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:28.038633 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.038606    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:04:28.039661 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:04:28.039635    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3bbe44a_2d6c_40a2_8658_3bceccb0c369.slice/crio-027e4e0b185e4d3b8b06660f1e71942e44e1f88cd5c44bd68810cc2bd9478982 WatchSource:0}: Error finding container 027e4e0b185e4d3b8b06660f1e71942e44e1f88cd5c44bd68810cc2bd9478982: Status 404 returned error can't find the container with id 027e4e0b185e4d3b8b06660f1e71942e44e1f88cd5c44bd68810cc2bd9478982
Jul 09 15:04:28.197780 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.197753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:28.200276 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.200254    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") pod \"maas-controller-85566d4fc9-tjxjp\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") " pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:28.355156 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.355060    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:28.491443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.491418    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:28.494345 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:04:28.494318    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f59a125_6434_4f03_831b_c66a0f5114fa.slice/crio-86a32c053f1c76b33ab63b3ef42f2255ab0ada8aa2a823aa83064cabf77c9e1e WatchSource:0}: Error finding container 86a32c053f1c76b33ab63b3ef42f2255ab0ada8aa2a823aa83064cabf77c9e1e: Status 404 returned error can't find the container with id 86a32c053f1c76b33ab63b3ef42f2255ab0ada8aa2a823aa83064cabf77c9e1e
Jul 09 15:04:28.794402 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.794365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-nbmvs" event={"ID":"b3bbe44a-2d6c-40a2-8658-3bceccb0c369","Type":"ContainerStarted","Data":"027e4e0b185e4d3b8b06660f1e71942e44e1f88cd5c44bd68810cc2bd9478982"}
Jul 09 15:04:28.795526 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:28.795497    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" event={"ID":"0f59a125-6434-4f03-831b-c66a0f5114fa","Type":"ContainerStarted","Data":"86a32c053f1c76b33ab63b3ef42f2255ab0ada8aa2a823aa83064cabf77c9e1e"}
Jul 09 15:04:32.799134 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.799078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:32.819620 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.819582    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-nbmvs" event={"ID":"b3bbe44a-2d6c-40a2-8658-3bceccb0c369","Type":"ContainerStarted","Data":"a7365e18b0aee5e0c6018ed870b7b735a1e76af6e8144378038379e57d5dae03"}
Jul 09 15:04:32.819795 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.819645    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:32.821163 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.821134    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" event={"ID":"0f59a125-6434-4f03-831b-c66a0f5114fa","Type":"ContainerStarted","Data":"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"}
Jul 09 15:04:32.821276 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.821217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:32.862721 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.862628    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-848487dc69-nbmvs" podStartSLOduration=1.316974864 podStartE2EDuration="5.862611802s" totalImagesPullingTime="4.545636938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:32.859813595 +0000 UTC m=+563.274998664" watchObservedRunningTime="2026-07-09 15:04:32.862611802 +0000 UTC m=+563.277796878"
Jul 09 15:04:32.904787 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.904740    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" podStartSLOduration=1.8037679770000001 podStartE2EDuration="5.904726061s" totalImagesPullingTime="4.100958084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:04:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:04:32.8980455 +0000 UTC m=+563.313230579" watchObservedRunningTime="2026-07-09 15:04:32.904726061 +0000 UTC m=+563.319911137"
Jul 09 15:04:32.946596 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:32.946565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:43.835088 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:43.835055    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:43.835475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:43.835210    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:04:43.909461 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:43.909428    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:43.909700 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:43.909639    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" podUID="0f59a125-6434-4f03-831b-c66a0f5114fa" containerName="manager" containerID="cri-o://fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626" gracePeriod=30
Jul 09 15:04:44.160352 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.160327    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:44.231676 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.231648    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fns8r\" (UniqueName: \"kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r\") pod \"0f59a125-6434-4f03-831b-c66a0f5114fa\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") "
Jul 09 15:04:44.231852 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.231689    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") pod \"0f59a125-6434-4f03-831b-c66a0f5114fa\" (UID: \"0f59a125-6434-4f03-831b-c66a0f5114fa\") "
Jul 09 15:04:44.233914 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.233886    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f59a125-6434-4f03-831b-c66a0f5114fa" (UID: "0f59a125-6434-4f03-831b-c66a0f5114fa"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:04:44.233914 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.233890    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r" (OuterVolumeSpecName: "kube-api-access-fns8r") pod "0f59a125-6434-4f03-831b-c66a0f5114fa" (UID: "0f59a125-6434-4f03-831b-c66a0f5114fa"). InnerVolumeSpecName "kube-api-access-fns8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:44.333072 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.333041    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fns8r\" (UniqueName: \"kubernetes.io/projected/0f59a125-6434-4f03-831b-c66a0f5114fa-kube-api-access-fns8r\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:44.333072 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.333065    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f59a125-6434-4f03-831b-c66a0f5114fa-webhook-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:44.888226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.888196    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f59a125-6434-4f03-831b-c66a0f5114fa" containerID="fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626" exitCode=0
Jul 09 15:04:44.888665 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.888244    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85566d4fc9-tjxjp"
Jul 09 15:04:44.888665 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.888272    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" event={"ID":"0f59a125-6434-4f03-831b-c66a0f5114fa","Type":"ContainerDied","Data":"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"}
Jul 09 15:04:44.888665 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.888312    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85566d4fc9-tjxjp" event={"ID":"0f59a125-6434-4f03-831b-c66a0f5114fa","Type":"ContainerDied","Data":"86a32c053f1c76b33ab63b3ef42f2255ab0ada8aa2a823aa83064cabf77c9e1e"}
Jul 09 15:04:44.888665 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.888335    2578 scope.go:117] "RemoveContainer" containerID="fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"
Jul 09 15:04:44.897757 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.897742    2578 scope.go:117] "RemoveContainer" containerID="fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"
Jul 09 15:04:44.897976 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:04:44.897959    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626\": container with ID starting with fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626 not found: ID does not exist" containerID="fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"
Jul 09 15:04:44.898053 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.897984    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626"} err="failed to get container status \"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626\": rpc error: code = NotFound desc = could not find container \"fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626\": container with ID starting with fdef7e60fbb03737b82c7b2d023517baca382c645a8c46c210578776307e4626 not found: ID does not exist"
Jul 09 15:04:44.921296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.921269    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:44.934717 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:44.934692    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85566d4fc9-tjxjp"]
Jul 09 15:04:46.123811 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:46.123773    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f59a125-6434-4f03-831b-c66a0f5114fa" path="/var/lib/kubelet/pods/0f59a125-6434-4f03-831b-c66a0f5114fa/volumes"
Jul 09 15:04:47.844092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:47.844056    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57546d5dfc-n9lqw" podUID="c3be0836-b67f-413a-be93-feda92e04bdc" containerName="console" containerID="cri-o://3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc" gracePeriod=15
Jul 09 15:04:48.092550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.092525    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 15:04:48.167405 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167336    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167405 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167387    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167419    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167485    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167524    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-84pgj\" (UniqueName: \"kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167569    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca\") pod \"c3be0836-b67f-413a-be93-feda92e04bdc\" (UID: \"c3be0836-b67f-413a-be93-feda92e04bdc\") "
Jul 09 15:04:48.167883 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167843    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:04:48.167974 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167952    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-trusted-ca-bundle\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.168115 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.167975    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config" (OuterVolumeSpecName: "console-config") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:04:48.168581 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.168545    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:04:48.168679 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.168636    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca" (OuterVolumeSpecName: "service-ca") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:04:48.169851 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.169830    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:04:48.170039 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.170015    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj" (OuterVolumeSpecName: "kube-api-access-84pgj") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "kube-api-access-84pgj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:04:48.170145 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.170048    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c3be0836-b67f-413a-be93-feda92e04bdc" (UID: "c3be0836-b67f-413a-be93-feda92e04bdc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:04:48.268517 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268488    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-oauth-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.268517 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268512    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-oauth-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.268657 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268521    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-console-config\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.268657 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268531    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3be0836-b67f-413a-be93-feda92e04bdc-console-serving-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.268657 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268539    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-84pgj\" (UniqueName: \"kubernetes.io/projected/c3be0836-b67f-413a-be93-feda92e04bdc-kube-api-access-84pgj\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.268657 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.268548    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3be0836-b67f-413a-be93-feda92e04bdc-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:04:48.911523 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.911492    2578 generic.go:356] "Generic (PLEG): container finished" podID="c3be0836-b67f-413a-be93-feda92e04bdc" containerID="3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc" exitCode=0
Jul 09 15:04:48.911949 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.911554    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57546d5dfc-n9lqw"
Jul 09 15:04:48.911949 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.911577    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57546d5dfc-n9lqw" event={"ID":"c3be0836-b67f-413a-be93-feda92e04bdc","Type":"ContainerDied","Data":"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"}
Jul 09 15:04:48.911949 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.911626    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57546d5dfc-n9lqw" event={"ID":"c3be0836-b67f-413a-be93-feda92e04bdc","Type":"ContainerDied","Data":"7f4cc6035d83ac11bdac4015fe26143a4ee963e1a2cd1e73e7b064186bad60fa"}
Jul 09 15:04:48.911949 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.911646    2578 scope.go:117] "RemoveContainer" containerID="3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"
Jul 09 15:04:48.921083 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.921068    2578 scope.go:117] "RemoveContainer" containerID="3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"
Jul 09 15:04:48.921361 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:04:48.921342    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc\": container with ID starting with 3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc not found: ID does not exist" containerID="3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"
Jul 09 15:04:48.921432 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.921370    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc"} err="failed to get container status \"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc\": rpc error: code = NotFound desc = could not find container \"3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc\": container with ID starting with 3175bcd7db6b0b945c2c88c94c3e59d6d40769d6fb27eccc83e8f4e5f7dd58bc not found: ID does not exist"
Jul 09 15:04:48.934744 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.934723    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 15:04:48.938904 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:48.938884    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57546d5dfc-n9lqw"]
Jul 09 15:04:50.126538 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:50.126509    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3be0836-b67f-413a-be93-feda92e04bdc" path="/var/lib/kubelet/pods/c3be0836-b67f-413a-be93-feda92e04bdc/volumes"
Jul 09 15:04:53.676106 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:53.676062    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:04:53.835417 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:04:53.835378    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:02.153635 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.153602    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:02.655779 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.655744    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"]
Jul 09 15:05:02.656107 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656095    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59a125-6434-4f03-831b-c66a0f5114fa" containerName="manager"
Jul 09 15:05:02.656159 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656108    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59a125-6434-4f03-831b-c66a0f5114fa" containerName="manager"
Jul 09 15:05:02.656159 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656128    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3be0836-b67f-413a-be93-feda92e04bdc" containerName="console"
Jul 09 15:05:02.656159 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656133    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3be0836-b67f-413a-be93-feda92e04bdc" containerName="console"
Jul 09 15:05:02.656258 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656187    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3be0836-b67f-413a-be93-feda92e04bdc" containerName="console"
Jul 09 15:05:02.656258 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.656195    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59a125-6434-4f03-831b-c66a0f5114fa" containerName="manager"
Jul 09 15:05:02.658524 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.658509    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.661081 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.661058    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Jul 09 15:05:02.661244 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.661228    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-sszck\""
Jul 09 15:05:02.671095 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.671075    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"]
Jul 09 15:05:02.734276 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.734251    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:02.786848 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.786819    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597ec0d2-da44-4550-ba04-b162900f5734-maas-api-tls\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.786975 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.786872    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ph7pk\" (UniqueName: \"kubernetes.io/projected/597ec0d2-da44-4550-ba04-b162900f5734-kube-api-access-ph7pk\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.786975 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.786967    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597ec0d2-da44-4550-ba04-b162900f5734-openshift-service-ca\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.790511 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.790487    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:02.888100 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.888072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597ec0d2-da44-4550-ba04-b162900f5734-maas-api-tls\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.888230 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.888132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ph7pk\" (UniqueName: \"kubernetes.io/projected/597ec0d2-da44-4550-ba04-b162900f5734-kube-api-access-ph7pk\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.888230 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.888215    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597ec0d2-da44-4550-ba04-b162900f5734-openshift-service-ca\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.888955 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.888937    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/597ec0d2-da44-4550-ba04-b162900f5734-openshift-service-ca\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.890775 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.890755    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/597ec0d2-da44-4550-ba04-b162900f5734-maas-api-tls\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.900546 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.900521    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ph7pk\" (UniqueName: \"kubernetes.io/projected/597ec0d2-da44-4550-ba04-b162900f5734-kube-api-access-ph7pk\") pod \"maas-api-5cdfbcf6cb-qkhwr\" (UID: \"597ec0d2-da44-4550-ba04-b162900f5734\") " pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:02.968542 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:02.968517    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:03.113099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.113072    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"]
Jul 09 15:05:03.114970 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:05:03.114942    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod597ec0d2_da44_4550_ba04_b162900f5734.slice/crio-08c3f5ee792a56a2664ce8644d30817c03a90ce8e44d7d9768c26120f4b73e03 WatchSource:0}: Error finding container 08c3f5ee792a56a2664ce8644d30817c03a90ce8e44d7d9768c26120f4b73e03: Status 404 returned error can't find the container with id 08c3f5ee792a56a2664ce8644d30817c03a90ce8e44d7d9768c26120f4b73e03
Jul 09 15:05:03.294824 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.294752    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4gmm5"]
Jul 09 15:05:03.298172 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.298151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.303431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.303413    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-wvsb8\""
Jul 09 15:05:03.310426 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.310408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 09 15:05:03.315464 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.315443    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4gmm5"]
Jul 09 15:05:03.393027 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.392977    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb5abcc-72e6-4bc2-865f-268fac0f626f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.393179 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.393031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svhmz\" (UniqueName: \"kubernetes.io/projected/3bb5abcc-72e6-4bc2-865f-268fac0f626f-kube-api-access-svhmz\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.493683 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.493653    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb5abcc-72e6-4bc2-865f-268fac0f626f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.493683 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.493684    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svhmz\" (UniqueName: \"kubernetes.io/projected/3bb5abcc-72e6-4bc2-865f-268fac0f626f-kube-api-access-svhmz\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.494373 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.494351    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3bb5abcc-72e6-4bc2-865f-268fac0f626f-plugins-config-volume\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.502529 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.502499    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svhmz\" (UniqueName: \"kubernetes.io/projected/3bb5abcc-72e6-4bc2-865f-268fac0f626f-kube-api-access-svhmz\") pod \"payload-processing-58f86c7798-4gmm5\" (UID: \"3bb5abcc-72e6-4bc2-865f-268fac0f626f\") " pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.608726 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.608658    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:03.768574 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.768542    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-4gmm5"]
Jul 09 15:05:03.772474 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:05:03.772449    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bb5abcc_72e6_4bc2_865f_268fac0f626f.slice/crio-d2cd78ae22afb321ee18b7c1cbb55604495000eced5303b6f3d57b00d9983d6e WatchSource:0}: Error finding container d2cd78ae22afb321ee18b7c1cbb55604495000eced5303b6f3d57b00d9983d6e: Status 404 returned error can't find the container with id d2cd78ae22afb321ee18b7c1cbb55604495000eced5303b6f3d57b00d9983d6e
Jul 09 15:05:03.992880 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.992830    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5" event={"ID":"3bb5abcc-72e6-4bc2-865f-268fac0f626f","Type":"ContainerStarted","Data":"d2cd78ae22afb321ee18b7c1cbb55604495000eced5303b6f3d57b00d9983d6e"}
Jul 09 15:05:03.994135 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:03.994104    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr" event={"ID":"597ec0d2-da44-4550-ba04-b162900f5734","Type":"ContainerStarted","Data":"08c3f5ee792a56a2664ce8644d30817c03a90ce8e44d7d9768c26120f4b73e03"}
Jul 09 15:05:04.914469 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:04.914431    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:05.015389 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:05.015355    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:06.006382 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.006343    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5" event={"ID":"3bb5abcc-72e6-4bc2-865f-268fac0f626f","Type":"ContainerStarted","Data":"57a5739a93164351c21aa0ec08c968e31b745bd9ae3b1690ce1b27b19523b479"}
Jul 09 15:05:06.006848 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.006414    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:06.007897 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.007872    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr" event={"ID":"597ec0d2-da44-4550-ba04-b162900f5734","Type":"ContainerStarted","Data":"38928a7042b913e2e4ab7ece621ad2c984c2fa5ef7aff12f6c354194ed42bf3f"}
Jul 09 15:05:06.008034 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.008020    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:06.027853 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.027810    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5" podStartSLOduration=1.498199852 podStartE2EDuration="3.027795557s" totalImagesPullingTime="1.529595705s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:06.02563502 +0000 UTC m=+596.440820095" watchObservedRunningTime="2026-07-09 15:05:06.027795557 +0000 UTC m=+596.442980632"
Jul 09 15:05:06.045955 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:06.045909    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr" podStartSLOduration=2.2057410060000002 podStartE2EDuration="4.045892261s" totalImagesPullingTime="1.840151255s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:06.04426338 +0000 UTC m=+596.459448458" watchObservedRunningTime="2026-07-09 15:05:06.045892261 +0000 UTC m=+596.461077339"
Jul 09 15:05:10.047226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:10.047198    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:05:10.048333 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:10.048304    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:05:12.019116 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:12.019089    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5cdfbcf6cb-qkhwr"
Jul 09 15:05:13.032778 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:13.032741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:13.133024 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:13.132953    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:17.016138 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:17.016104    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-4gmm5"
Jul 09 15:05:26.400498 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.400460    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"]
Jul 09 15:05:26.403278 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.403258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.407442 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.407418    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 09 15:05:26.407442 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.407442    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 09 15:05:26.407709 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.407418    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 09 15:05:26.407709 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.407418    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qjgf2\""
Jul 09 15:05:26.423192 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.423157    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"]
Jul 09 15:05:26.430515 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.427752    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:26.494899 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.494863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.494899 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.494899    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.495184 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.494920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.495184 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.494939    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7b4b10-22f4-47a9-956d-af101248df95-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.495184 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.494964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xr4t2\" (UniqueName: \"kubernetes.io/projected/1c7b4b10-22f4-47a9-956d-af101248df95-kube-api-access-xr4t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.495184 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.495056    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596239 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596239 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596238    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7b4b10-22f4-47a9-956d-af101248df95-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596503 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xr4t2\" (UniqueName: \"kubernetes.io/projected/1c7b4b10-22f4-47a9-956d-af101248df95-kube-api-access-xr4t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596503 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596290    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596503 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596503 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596776 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596696    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596776 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596719    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.596776 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.596759    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.598730 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.598704    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c7b4b10-22f4-47a9-956d-af101248df95-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.599022 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.598977    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c7b4b10-22f4-47a9-956d-af101248df95-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.607613 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.607579    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xr4t2\" (UniqueName: \"kubernetes.io/projected/1c7b4b10-22f4-47a9-956d-af101248df95-kube-api-access-xr4t2\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf\" (UID: \"1c7b4b10-22f4-47a9-956d-af101248df95\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.714447 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.714406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:26.857947 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.857917    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"]
Jul 09 15:05:26.859657 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:05:26.859629    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c7b4b10_22f4_47a9_956d_af101248df95.slice/crio-7f9ec4c597dd300705296cf14bb9ce168f90ca1e285f7f008f2f95a991faa63b WatchSource:0}: Error finding container 7f9ec4c597dd300705296cf14bb9ce168f90ca1e285f7f008f2f95a991faa63b: Status 404 returned error can't find the container with id 7f9ec4c597dd300705296cf14bb9ce168f90ca1e285f7f008f2f95a991faa63b
Jul 09 15:05:26.861034 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:26.861016    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:05:27.123246 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:27.123153    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf" event={"ID":"1c7b4b10-22f4-47a9-956d-af101248df95","Type":"ContainerStarted","Data":"7f9ec4c597dd300705296cf14bb9ce168f90ca1e285f7f008f2f95a991faa63b"}
Jul 09 15:05:28.129802 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:28.129771    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf" event={"ID":"1c7b4b10-22f4-47a9-956d-af101248df95","Type":"ContainerStarted","Data":"675659a3be4b844c40c576a218516a7e60eb1e1c096374dd0ad4dc2c73f886dd"}
Jul 09 15:05:28.151226 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:28.151176    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf" podStartSLOduration=1.106121291 podStartE2EDuration="2.151159783s" totalImagesPullingTime="1.045038492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:28.149896299 +0000 UTC m=+618.565081376" watchObservedRunningTime="2026-07-09 15:05:28.151159783 +0000 UTC m=+618.566344876"
Jul 09 15:05:36.715294 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:36.715196    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:36.715294 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:36.715260    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:36.728476 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:36.728452    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:37.185521 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:37.185443    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf"
Jul 09 15:05:40.896565 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:40.896530    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:44.907999 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.907949    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"]
Jul 09 15:05:44.912459 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.912438    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.915438 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.915409    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jul 09 15:05:44.932335 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.932300    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"]
Jul 09 15:05:44.951276 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.951237    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:44.963912 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.963884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.964056 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.963921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.964056 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.963938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.964056 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.964020    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.964206 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.964089    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:44.964206 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:44.964112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82bzs\" (UniqueName: \"kubernetes.io/projected/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-kube-api-access-82bzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064628 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064593    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82bzs\" (UniqueName: \"kubernetes.io/projected/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-kube-api-access-82bzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064803 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064803 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064701    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064803 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064718    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064803 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.064803 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.064802    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.065254 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.065229    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.065254 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.065246    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.065388 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.065289    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.067150 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.067128    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.067749 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.067730    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.076259 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.076237    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82bzs\" (UniqueName: \"kubernetes.io/projected/03805c69-89b1-45c7-8a6a-7d1d2a374e2b-kube-api-access-82bzs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-mvrcv\" (UID: \"03805c69-89b1-45c7-8a6a-7d1d2a374e2b\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.225340 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.225311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:45.367237 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:45.367186    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"]
Jul 09 15:05:45.370612 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:05:45.370587    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03805c69_89b1_45c7_8a6a_7d1d2a374e2b.slice/crio-aca179b97b8aa4b9e74bea13cce0aebcde346b39f09dd096442218801b347133 WatchSource:0}: Error finding container aca179b97b8aa4b9e74bea13cce0aebcde346b39f09dd096442218801b347133: Status 404 returned error can't find the container with id aca179b97b8aa4b9e74bea13cce0aebcde346b39f09dd096442218801b347133
Jul 09 15:05:46.221461 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:46.221416    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv" event={"ID":"03805c69-89b1-45c7-8a6a-7d1d2a374e2b","Type":"ContainerStarted","Data":"8bd3370eead10025b9b893127b6f75985eca8b2dad89c8fffcadab30c319c70c"}
Jul 09 15:05:46.221853 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:46.221472    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv" event={"ID":"03805c69-89b1-45c7-8a6a-7d1d2a374e2b","Type":"ContainerStarted","Data":"aca179b97b8aa4b9e74bea13cce0aebcde346b39f09dd096442218801b347133"}
Jul 09 15:05:46.243104 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:46.243047    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv" podStartSLOduration=1.935111997 podStartE2EDuration="2.243028851s" totalImagesPullingTime="307.916854ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:05:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:05:46.241411853 +0000 UTC m=+636.656596931" watchObservedRunningTime="2026-07-09 15:05:46.243028851 +0000 UTC m=+636.658213927"
Jul 09 15:05:48.685643 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:48.685603    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:05:55.226369 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:55.226329    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:55.226786 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:55.226408    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:55.239043 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:55.238985    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:05:55.284053 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:05:55.284022    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-mvrcv"
Jul 09 15:06:00.445216 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:06:00.445176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:04.216046 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:06:04.215969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:16.857494 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:06:16.857448    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:23.945719 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:06:23.945679    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:06:25.828457 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:06:25.828412    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:46.928958 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:46.928921    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:46.994781 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:46.994737    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:53.593128 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:53.593078    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:53.687025 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:53.686976    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:54.721819 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:54.721782    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:07:54.820096 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:07:54.820060    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:34.107298 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:08:34.107207    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:08:55.477860 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:08:55.477821    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:04.932058 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:04.932007    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:05.059369 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.059329    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:09:05.059585 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.059519    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-848487dc69-nbmvs" podUID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" containerName="manager" containerID="cri-o://a7365e18b0aee5e0c6018ed870b7b735a1e76af6e8144378038379e57d5dae03" gracePeriod=30
Jul 09 15:09:05.278913 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.278883    2578 generic.go:356] "Generic (PLEG): container finished" podID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" containerID="a7365e18b0aee5e0c6018ed870b7b735a1e76af6e8144378038379e57d5dae03" exitCode=0
Jul 09 15:09:05.279094 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.278933    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-nbmvs" event={"ID":"b3bbe44a-2d6c-40a2-8658-3bceccb0c369","Type":"ContainerDied","Data":"a7365e18b0aee5e0c6018ed870b7b735a1e76af6e8144378038379e57d5dae03"}
Jul 09 15:09:05.311718 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.311697    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:09:05.443144 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.443113    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert\") pod \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") "
Jul 09 15:09:05.443291 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.443165    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7zmv\" (UniqueName: \"kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv\") pod \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\" (UID: \"b3bbe44a-2d6c-40a2-8658-3bceccb0c369\") "
Jul 09 15:09:05.445237 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.445214    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "b3bbe44a-2d6c-40a2-8658-3bceccb0c369" (UID: "b3bbe44a-2d6c-40a2-8658-3bceccb0c369"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:09:05.445321 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.445307    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv" (OuterVolumeSpecName: "kube-api-access-t7zmv") pod "b3bbe44a-2d6c-40a2-8658-3bceccb0c369" (UID: "b3bbe44a-2d6c-40a2-8658-3bceccb0c369"). InnerVolumeSpecName "kube-api-access-t7zmv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:09:05.543748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.543689    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-webhook-cert\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:09:05.543748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:05.543709    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7zmv\" (UniqueName: \"kubernetes.io/projected/b3bbe44a-2d6c-40a2-8658-3bceccb0c369-kube-api-access-t7zmv\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:09:06.285205 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.285173    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-nbmvs" event={"ID":"b3bbe44a-2d6c-40a2-8658-3bceccb0c369","Type":"ContainerDied","Data":"027e4e0b185e4d3b8b06660f1e71942e44e1f88cd5c44bd68810cc2bd9478982"}
Jul 09 15:09:06.285205 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.285206    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-nbmvs"
Jul 09 15:09:06.285643 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.285244    2578 scope.go:117] "RemoveContainer" containerID="a7365e18b0aee5e0c6018ed870b7b735a1e76af6e8144378038379e57d5dae03"
Jul 09 15:09:06.303980 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.303952    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:09:06.308575 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.308552    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-848487dc69-nbmvs"]
Jul 09 15:09:06.967039 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:06.967008    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:07.082077 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.082047    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-848487dc69-s8ffz"]
Jul 09 15:09:07.082415 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.082403    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" containerName="manager"
Jul 09 15:09:07.082465 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.082416    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" containerName="manager"
Jul 09 15:09:07.082501 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.082483    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" containerName="manager"
Jul 09 15:09:07.085405 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.085389    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.089427 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.089398    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 09 15:09:07.089427 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.089426    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-9xcgw\""
Jul 09 15:09:07.089615 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.089433    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 09 15:09:07.096513 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.096479    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848487dc69-s8ffz"]
Jul 09 15:09:07.156397 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.156373    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8pg8\" (UniqueName: \"kubernetes.io/projected/bf09f557-a978-4e6b-913d-7deb50c81cdb-kube-api-access-b8pg8\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.156515 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.156430    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf09f557-a978-4e6b-913d-7deb50c81cdb-webhook-cert\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.257801 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.257741    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8pg8\" (UniqueName: \"kubernetes.io/projected/bf09f557-a978-4e6b-913d-7deb50c81cdb-kube-api-access-b8pg8\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.257801 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.257793    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf09f557-a978-4e6b-913d-7deb50c81cdb-webhook-cert\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.260400 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.260372    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bf09f557-a978-4e6b-913d-7deb50c81cdb-webhook-cert\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.266469 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.266448    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8pg8\" (UniqueName: \"kubernetes.io/projected/bf09f557-a978-4e6b-913d-7deb50c81cdb-kube-api-access-b8pg8\") pod \"maas-controller-848487dc69-s8ffz\" (UID: \"bf09f557-a978-4e6b-913d-7deb50c81cdb\") " pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.396179 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.396152    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:07.533553 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:07.533527    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-848487dc69-s8ffz"]
Jul 09 15:09:07.535468 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:09:07.535438    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf09f557_a978_4e6b_913d_7deb50c81cdb.slice/crio-418afb9823014853871415754d4b27639ee314cce52a00de01c03039a7bd5f53 WatchSource:0}: Error finding container 418afb9823014853871415754d4b27639ee314cce52a00de01c03039a7bd5f53: Status 404 returned error can't find the container with id 418afb9823014853871415754d4b27639ee314cce52a00de01c03039a7bd5f53
Jul 09 15:09:08.129314 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:08.129278    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3bbe44a-2d6c-40a2-8658-3bceccb0c369" path="/var/lib/kubelet/pods/b3bbe44a-2d6c-40a2-8658-3bceccb0c369/volumes"
Jul 09 15:09:08.298764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:08.298684    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-s8ffz" event={"ID":"bf09f557-a978-4e6b-913d-7deb50c81cdb","Type":"ContainerStarted","Data":"5b1d9696fb4d6b87e1080e2f644aee5379f311c60bd59043cb52b454f08152a1"}
Jul 09 15:09:08.298764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:08.298737    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-848487dc69-s8ffz" event={"ID":"bf09f557-a978-4e6b-913d-7deb50c81cdb","Type":"ContainerStarted","Data":"418afb9823014853871415754d4b27639ee314cce52a00de01c03039a7bd5f53"}
Jul 09 15:09:08.298937 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:08.298776    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:08.319701 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:08.319656    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-848487dc69-s8ffz" podStartSLOduration=0.843533725 podStartE2EDuration="1.319642562s" totalImagesPullingTime="476.108837ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:09:08.316952148 +0000 UTC m=+838.732137223" watchObservedRunningTime="2026-07-09 15:09:08.319642562 +0000 UTC m=+838.734827636"
Jul 09 15:09:19.310711 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:19.310676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-848487dc69-s8ffz"
Jul 09 15:09:42.219220 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:42.219187    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:48.112438 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:48.112403    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:48.213050 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:48.213016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:53.971045 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:53.971006    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:54.075698 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:54.075663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:54.661706 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:54.661670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:09:54.761681 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:09:54.761645    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:00.277890 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:10:00.277851    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:00.377797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:10:00.377716    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:05.078357 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:10:05.078304    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:10:10.082695 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:10:10.082668    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:10:10.085022 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:10:10.084985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:12:30.995373 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:12:30.995339    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:13:58.743518 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:13:58.743484    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:13:58.803661 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:13:58.803631    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:15:00.158567 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.158470    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:15:00.161252 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.161229    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:15:00.184947 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.184903    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:15:00.290959 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.290920    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ftdw\" (UniqueName: \"kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw\") pod \"maas-api-key-cleanup-29726835-h9jkj\" (UID: \"c983b9d3-9afc-4033-b4ba-8f890f73c4ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:15:00.391644 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.391613    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ftdw\" (UniqueName: \"kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw\") pod \"maas-api-key-cleanup-29726835-h9jkj\" (UID: \"c983b9d3-9afc-4033-b4ba-8f890f73c4ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:15:00.403719 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.403690    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ftdw\" (UniqueName: \"kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw\") pod \"maas-api-key-cleanup-29726835-h9jkj\" (UID: \"c983b9d3-9afc-4033-b4ba-8f890f73c4ff\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:15:00.471425 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.471394    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:15:00.614118 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.614070    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:15:00.616777 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:15:00.616748    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc983b9d3_9afc_4033_b4ba_8f890f73c4ff.slice/crio-857b8f987cf60d69ac65cf894f764905cfc04dec181e121697f1b2c5edb53731 WatchSource:0}: Error finding container 857b8f987cf60d69ac65cf894f764905cfc04dec181e121697f1b2c5edb53731: Status 404 returned error can't find the container with id 857b8f987cf60d69ac65cf894f764905cfc04dec181e121697f1b2c5edb53731
Jul 09 15:15:00.618654 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:00.618638    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:15:01.192233 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:01.192195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" event={"ID":"c983b9d3-9afc-4033-b4ba-8f890f73c4ff","Type":"ContainerStarted","Data":"857b8f987cf60d69ac65cf894f764905cfc04dec181e121697f1b2c5edb53731"}
Jul 09 15:15:04.210942 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:04.210911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" event={"ID":"c983b9d3-9afc-4033-b4ba-8f890f73c4ff","Type":"ContainerStarted","Data":"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"}
Jul 09 15:15:04.228446 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:04.228390    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" podStartSLOduration=1.661878497 podStartE2EDuration="4.228366823s" totalImagesPullingTime="2.566488326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:15:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:15:04.227859616 +0000 UTC m=+1194.643044703" watchObservedRunningTime="2026-07-09 15:15:04.228366823 +0000 UTC m=+1194.643551901"
Jul 09 15:15:10.119910 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:10.119879    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:15:10.123804 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:15:10.123785    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:16:00.011384 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:00.011346    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:16:00.014007 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:00.011542    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" podUID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" containerName="cleanup" containerID="cri-o://b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b" gracePeriod=30
Jul 09 15:16:30.190836 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.190809    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:16:30.290824 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.290746    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2ftdw\" (UniqueName: \"kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw\") pod \"c983b9d3-9afc-4033-b4ba-8f890f73c4ff\" (UID: \"c983b9d3-9afc-4033-b4ba-8f890f73c4ff\") "
Jul 09 15:16:30.293090 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.293054    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw" (OuterVolumeSpecName: "kube-api-access-2ftdw") pod "c983b9d3-9afc-4033-b4ba-8f890f73c4ff" (UID: "c983b9d3-9afc-4033-b4ba-8f890f73c4ff"). InnerVolumeSpecName "kube-api-access-2ftdw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:16:30.391833 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.391803    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2ftdw\" (UniqueName: \"kubernetes.io/projected/c983b9d3-9afc-4033-b4ba-8f890f73c4ff-kube-api-access-2ftdw\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:16:30.678435 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.678351    2578 generic.go:356] "Generic (PLEG): container finished" podID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" containerID="b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b" exitCode=137
Jul 09 15:16:30.678435 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.678393    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"
Jul 09 15:16:30.678616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.678440    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" event={"ID":"c983b9d3-9afc-4033-b4ba-8f890f73c4ff","Type":"ContainerDied","Data":"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"}
Jul 09 15:16:30.678616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.678488    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj" event={"ID":"c983b9d3-9afc-4033-b4ba-8f890f73c4ff","Type":"ContainerDied","Data":"857b8f987cf60d69ac65cf894f764905cfc04dec181e121697f1b2c5edb53731"}
Jul 09 15:16:30.678616 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.678509    2578 scope.go:117] "RemoveContainer" containerID="b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"
Jul 09 15:16:30.693059 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.693036    2578 scope.go:117] "RemoveContainer" containerID="b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"
Jul 09 15:16:30.693317 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:16:30.693297    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b\": container with ID starting with b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b not found: ID does not exist" containerID="b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"
Jul 09 15:16:30.693376 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.693324    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b"} err="failed to get container status \"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b\": rpc error: code = NotFound desc = could not find container \"b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b\": container with ID starting with b3a83ebfc1efca00039e5430c5aefc3d72f2b683d9ea55fc8fbda0fb2e7c200b not found: ID does not exist"
Jul 09 15:16:30.710958 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.710929    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:16:30.720599 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:30.720577    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29726835-h9jkj"]
Jul 09 15:16:32.123731 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:16:32.123679    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" path="/var/lib/kubelet/pods/c983b9d3-9afc-4033-b4ba-8f890f73c4ff/volumes"
Jul 09 15:17:38.140218 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:17:38.140142    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:17:50.297293 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:17:50.297265    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:10.162012 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:10.161973    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:20:10.166674 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:10.166648    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:20:52.622600 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:52.622566    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:52.710279 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:52.710241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:53.134841 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:53.134800    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:59.272025 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:59.271958    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:59.375277 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:59.375245    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:59.680052 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:59.679954    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:20:59.774675 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:20:59.774648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:00.772443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.772402    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:00.866609 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.866576    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:00.892235 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.892203    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:00.892615 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.892601    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" containerName="cleanup"
Jul 09 15:21:00.892659 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.892618    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" containerName="cleanup"
Jul 09 15:21:00.892709 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.892700    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c983b9d3-9afc-4033-b4ba-8f890f73c4ff" containerName="cleanup"
Jul 09 15:21:00.895759 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.895739    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:00.898637 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.898618    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0fa0eda3-serving-cert\""
Jul 09 15:21:00.908804 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.908782    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:00.982494 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.982458    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:00.982680 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.982578    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:00.982680 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:00.982615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljs67\" (UniqueName: \"kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.083492 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.083403    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.083492 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.083457    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.083492 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.083483    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljs67\" (UniqueName: \"kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.084106 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.084084    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.086158 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.086137    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.093218 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.093193    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljs67\" (UniqueName: \"kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67\") pod \"maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.206471 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.206437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:01.365909 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.365836    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:01.369137 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:21:01.369110    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d07aa98_bd93_47c4_b6da_024007825f98.slice/crio-44b7f025983ddff139df36b0eb5a1ebaf1b704fc5253d0ad5b6172c4f2041787 WatchSource:0}: Error finding container 44b7f025983ddff139df36b0eb5a1ebaf1b704fc5253d0ad5b6172c4f2041787: Status 404 returned error can't find the container with id 44b7f025983ddff139df36b0eb5a1ebaf1b704fc5253d0ad5b6172c4f2041787
Jul 09 15:21:01.370548 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:01.370533    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:21:02.108844 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.108806    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:02.133937 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.133906    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" event={"ID":"0d07aa98-bd93-47c4-b6da-024007825f98","Type":"ContainerStarted","Data":"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"}
Jul 09 15:21:02.134133 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.133963    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" event={"ID":"0d07aa98-bd93-47c4-b6da-024007825f98","Type":"ContainerStarted","Data":"44b7f025983ddff139df36b0eb5a1ebaf1b704fc5253d0ad5b6172c4f2041787"}
Jul 09 15:21:02.134133 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.134085    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:02.156764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.156715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" podStartSLOduration=1.5854701329999998 podStartE2EDuration="2.156700977s" totalImagesPullingTime="571.230844ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:21:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:21:02.15406309 +0000 UTC m=+1552.569248166" watchObservedRunningTime="2026-07-09 15:21:02.156700977 +0000 UTC m=+1552.571886053"
Jul 09 15:21:02.307168 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:02.307127    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:05.845292 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:05.845256    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:06.054283 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.054242    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:06.234965 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.234926    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:06.300381 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.300346    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:06.502061 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.501938    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:06.502256 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.502204    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" podUID="0d07aa98-bd93-47c4-b6da-024007825f98" containerName="maas-api" containerID="cri-o://ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95" gracePeriod=30
Jul 09 15:21:06.529664 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.529627    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:06.752775 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.752715    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:06.838449 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.838421    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljs67\" (UniqueName: \"kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67\") pod \"0d07aa98-bd93-47c4-b6da-024007825f98\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") "
Jul 09 15:21:06.838622 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.838508    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca\") pod \"0d07aa98-bd93-47c4-b6da-024007825f98\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") "
Jul 09 15:21:06.838622 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.838559    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls\") pod \"0d07aa98-bd93-47c4-b6da-024007825f98\" (UID: \"0d07aa98-bd93-47c4-b6da-024007825f98\") "
Jul 09 15:21:06.838906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.838884    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "0d07aa98-bd93-47c4-b6da-024007825f98" (UID: "0d07aa98-bd93-47c4-b6da-024007825f98"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:21:06.840713 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.840692    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "0d07aa98-bd93-47c4-b6da-024007825f98" (UID: "0d07aa98-bd93-47c4-b6da-024007825f98"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:21:06.840786 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.840751    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67" (OuterVolumeSpecName: "kube-api-access-ljs67") pod "0d07aa98-bd93-47c4-b6da-024007825f98" (UID: "0d07aa98-bd93-47c4-b6da-024007825f98"). InnerVolumeSpecName "kube-api-access-ljs67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:21:06.939796 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.939764    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/0d07aa98-bd93-47c4-b6da-024007825f98-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:06.939796 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.939795    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/0d07aa98-bd93-47c4-b6da-024007825f98-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:06.939796 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:06.939803    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljs67\" (UniqueName: \"kubernetes.io/projected/0d07aa98-bd93-47c4-b6da-024007825f98-kube-api-access-ljs67\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:07.161134 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.161044    2578 generic.go:356] "Generic (PLEG): container finished" podID="0d07aa98-bd93-47c4-b6da-024007825f98" containerID="ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95" exitCode=0
Jul 09 15:21:07.161134 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.161090    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"
Jul 09 15:21:07.161385 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.161139    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" event={"ID":"0d07aa98-bd93-47c4-b6da-024007825f98","Type":"ContainerDied","Data":"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"}
Jul 09 15:21:07.161385 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.161194    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n" event={"ID":"0d07aa98-bd93-47c4-b6da-024007825f98","Type":"ContainerDied","Data":"44b7f025983ddff139df36b0eb5a1ebaf1b704fc5253d0ad5b6172c4f2041787"}
Jul 09 15:21:07.161385 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.161222    2578 scope.go:117] "RemoveContainer" containerID="ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"
Jul 09 15:21:07.170743 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.170715    2578 scope.go:117] "RemoveContainer" containerID="ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"
Jul 09 15:21:07.171027 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:07.171006    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95\": container with ID starting with ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95 not found: ID does not exist" containerID="ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"
Jul 09 15:21:07.171108 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.171037    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95"} err="failed to get container status \"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95\": rpc error: code = NotFound desc = could not find container \"ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95\": container with ID starting with ec64d875863de7c52f3a9915fcdab428bf60de18b9b39e4a49bb1ef19e67ec95 not found: ID does not exist"
Jul 09 15:21:07.185518 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.185183    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:07.188110 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:07.188082    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fa0eda3-54b945bf47-llt4n"]
Jul 09 15:21:08.125071 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:08.125037    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d07aa98-bd93-47c4-b6da-024007825f98" path="/var/lib/kubelet/pods/0d07aa98-bd93-47c4-b6da-024007825f98/volumes"
Jul 09 15:21:08.188117 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:08.188083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:12.351150 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:12.351108    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:12.408879 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:12.408847    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:12.596083 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:12.596046    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:12.702121 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:12.702083    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:13.696937 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.696900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:13.776952 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.776921    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:13.777341 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.777328    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d07aa98-bd93-47c4-b6da-024007825f98" containerName="maas-api"
Jul 09 15:21:13.777396 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.777344    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d07aa98-bd93-47c4-b6da-024007825f98" containerName="maas-api"
Jul 09 15:21:13.777439 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.777427    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d07aa98-bd93-47c4-b6da-024007825f98" containerName="maas-api"
Jul 09 15:21:13.783295 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.783253    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:13.787723 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.787704    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:13.790918 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.790900    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-0fc76beb-serving-cert\""
Jul 09 15:21:13.796043 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.795968    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:13.858783 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.858730    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:13.906502 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.906464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx6nq\" (UniqueName: \"kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:13.906688 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.906513    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:13.906688 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:13.906571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.007232 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.007191    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx6nq\" (UniqueName: \"kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.007421 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.007254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.007421 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.007288    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.007514 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:14.007414    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-serving-cert: secret "maas-api-e2e-ait-0fc76beb-serving-cert" not found
Jul 09 15:21:14.007514 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:14.007493    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls podName:5944fda6-0f3e-4dd8-ad85-7fb8075968b9 nodeName:}" failed. No retries permitted until 2026-07-09 15:21:14.50747618 +0000 UTC m=+1564.922661234 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls") pod "maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" (UID: "5944fda6-0f3e-4dd8-ad85-7fb8075968b9") : secret "maas-api-e2e-ait-0fc76beb-serving-cert" not found
Jul 09 15:21:14.007967 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.007950    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.017470 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.017438    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx6nq\" (UniqueName: \"kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.487184 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.487152    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:14.512956 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.512928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.515739 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.515715    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") pod \"maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.587066 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.587030    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:14.699376 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.699337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:14.700219 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.700203    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:14.844846 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:14.844814    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:14.845874 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:21:14.845832    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5944fda6_0f3e_4dd8_ad85_7fb8075968b9.slice/crio-66348bc5ab43fe6dd5e3640fe377012b6a71c74e038607de4fad720d373764a9 WatchSource:0}: Error finding container 66348bc5ab43fe6dd5e3640fe377012b6a71c74e038607de4fad720d373764a9: Status 404 returned error can't find the container with id 66348bc5ab43fe6dd5e3640fe377012b6a71c74e038607de4fad720d373764a9
Jul 09 15:21:15.206511 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:15.206476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" event={"ID":"5944fda6-0f3e-4dd8-ad85-7fb8075968b9","Type":"ContainerStarted","Data":"66348bc5ab43fe6dd5e3640fe377012b6a71c74e038607de4fad720d373764a9"}
Jul 09 15:21:16.215766 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:16.215728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" event={"ID":"5944fda6-0f3e-4dd8-ad85-7fb8075968b9","Type":"ContainerStarted","Data":"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"}
Jul 09 15:21:16.216183 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:16.215857    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:16.237814 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:16.237769    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" podStartSLOduration=2.604760565 podStartE2EDuration="3.237752694s" totalImagesPullingTime="632.992129ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:21:16.235980253 +0000 UTC m=+1566.651165330" watchObservedRunningTime="2026-07-09 15:21:16.237752694 +0000 UTC m=+1566.652937827"
Jul 09 15:21:16.355870 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:16.355831    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:19.001946 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.001907    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:19.500194 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.500163    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:19.500366 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.500349    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" podUID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" containerName="maas-api" containerID="cri-o://3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014" gracePeriod=30
Jul 09 15:21:19.560778 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.560733    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:19.746965 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.746939    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:19.760568 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.760490    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca\") pod \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") "
Jul 09 15:21:19.760568 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.760533    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") pod \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") "
Jul 09 15:21:19.760772 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.760607    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx6nq\" (UniqueName: \"kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq\") pod \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\" (UID: \"5944fda6-0f3e-4dd8-ad85-7fb8075968b9\") "
Jul 09 15:21:19.760850 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.760827    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5944fda6-0f3e-4dd8-ad85-7fb8075968b9" (UID: "5944fda6-0f3e-4dd8-ad85-7fb8075968b9"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:21:19.762753 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.762726    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq" (OuterVolumeSpecName: "kube-api-access-sx6nq") pod "5944fda6-0f3e-4dd8-ad85-7fb8075968b9" (UID: "5944fda6-0f3e-4dd8-ad85-7fb8075968b9"). InnerVolumeSpecName "kube-api-access-sx6nq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:21:19.762865 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.762786    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5944fda6-0f3e-4dd8-ad85-7fb8075968b9" (UID: "5944fda6-0f3e-4dd8-ad85-7fb8075968b9"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:21:19.862047 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.862013    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx6nq\" (UniqueName: \"kubernetes.io/projected/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-kube-api-access-sx6nq\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:19.862047 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.862039    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:19.862047 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:19.862049    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5944fda6-0f3e-4dd8-ad85-7fb8075968b9-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:20.239391 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.239358    2578 generic.go:356] "Generic (PLEG): container finished" podID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" containerID="3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014" exitCode=0
Jul 09 15:21:20.239806 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.239412    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" event={"ID":"5944fda6-0f3e-4dd8-ad85-7fb8075968b9","Type":"ContainerDied","Data":"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"}
Jul 09 15:21:20.239806 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.239416    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"
Jul 09 15:21:20.239806 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.239485    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v" event={"ID":"5944fda6-0f3e-4dd8-ad85-7fb8075968b9","Type":"ContainerDied","Data":"66348bc5ab43fe6dd5e3640fe377012b6a71c74e038607de4fad720d373764a9"}
Jul 09 15:21:20.239806 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.239508    2578 scope.go:117] "RemoveContainer" containerID="3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"
Jul 09 15:21:20.248319 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.248302    2578 scope.go:117] "RemoveContainer" containerID="3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"
Jul 09 15:21:20.248616 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:20.248596    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014\": container with ID starting with 3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014 not found: ID does not exist" containerID="3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"
Jul 09 15:21:20.248668 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.248624    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014"} err="failed to get container status \"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014\": rpc error: code = NotFound desc = could not find container \"3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014\": container with ID starting with 3a7dc43215b79bdfc66ba12cce2f9bb97bccdabb16b47893a81f6f3ccc580014 not found: ID does not exist"
Jul 09 15:21:20.280900 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.280874    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:20.288235 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:20.288206    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-0fc76beb-78b9f4ff48-clg6v"]
Jul 09 15:21:22.123326 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:22.123285    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" path="/var/lib/kubelet/pods/5944fda6-0f3e-4dd8-ad85-7fb8075968b9/volumes"
Jul 09 15:21:25.202018 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:25.201960    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:25.307305 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:25.307271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:27.166199 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:27.166165    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:31.318591 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:31.318550    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:31.387491 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:31.387459    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:31.547869 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:31.547839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:31.645928 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:31.645846    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:32.741754 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.741718    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:32.838747 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.838710    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:32.962508 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.962472    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:32.963079 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.963064    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" containerName="maas-api"
Jul 09 15:21:32.963145 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.963083    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" containerName="maas-api"
Jul 09 15:21:32.963223 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.963212    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5944fda6-0f3e-4dd8-ad85-7fb8075968b9" containerName="maas-api"
Jul 09 15:21:32.967999 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.967967    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:32.970817 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.970795    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-derive-69810dc0-serving-cert\""
Jul 09 15:21:32.980792 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.980770    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:32.997285 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:32.997203    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:33.091078 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.091044    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.091273 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.091083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.091273 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.091184    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wplcw\" (UniqueName: \"kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.192192 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.192156    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.192192 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.192193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.192445 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.192235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wplcw\" (UniqueName: \"kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.192445 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:33.192374    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-serving-cert: secret "maas-api-e2e-derive-69810dc0-serving-cert" not found
Jul 09 15:21:33.192445 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:33.192446    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls podName:2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4 nodeName:}" failed. No retries permitted until 2026-07-09 15:21:33.692429556 +0000 UTC m=+1584.107614613 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls") pod "maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" (UID: "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4") : secret "maas-api-e2e-derive-69810dc0-serving-cert" not found
Jul 09 15:21:33.192884 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.192859    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.201710 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.201681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wplcw\" (UniqueName: \"kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.623958 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.623928    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:33.698417 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.698383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.700924 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.700898    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") pod \"maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") " pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:33.738547 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.738520    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:33.880506 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:33.880406    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:34.033726 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:34.033698    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:34.035002 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:21:34.034959    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ddbf47c_7796_44e9_a94a_dd4dafe7e2b4.slice/crio-093c92a3f32dafe1e68388833697acdaadcf9aab8eae2648cd8e32f49408a3f3 WatchSource:0}: Error finding container 093c92a3f32dafe1e68388833697acdaadcf9aab8eae2648cd8e32f49408a3f3: Status 404 returned error can't find the container with id 093c92a3f32dafe1e68388833697acdaadcf9aab8eae2648cd8e32f49408a3f3
Jul 09 15:21:34.317859 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:34.317828    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" event={"ID":"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4","Type":"ContainerStarted","Data":"093c92a3f32dafe1e68388833697acdaadcf9aab8eae2648cd8e32f49408a3f3"}
Jul 09 15:21:35.329550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:35.329509    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" event={"ID":"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4","Type":"ContainerStarted","Data":"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"}
Jul 09 15:21:35.330022 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:35.329676    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:35.348876 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:35.348812    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" podStartSLOduration=2.840594154 podStartE2EDuration="3.348772278s" totalImagesPullingTime="508.178124ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:21:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:21:35.346943545 +0000 UTC m=+1585.762128620" watchObservedRunningTime="2026-07-09 15:21:35.348772278 +0000 UTC m=+1585.763957355"
Jul 09 15:21:36.230268 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:36.230231    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:37.175125 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.175085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:37.342966 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.342934    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:37.462287 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.462254    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:37.581371 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.581337    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:37.581823 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.581787    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" podUID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" containerName="maas-api" containerID="cri-o://dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385" gracePeriod=30
Jul 09 15:21:37.605730 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.605701    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:37.832456 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.832434    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:37.939495 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.939464    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca\") pod \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") "
Jul 09 15:21:37.939699 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.939550    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wplcw\" (UniqueName: \"kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw\") pod \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") "
Jul 09 15:21:37.939699 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.939601    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") pod \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\" (UID: \"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4\") "
Jul 09 15:21:37.939902 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.939878    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" (UID: "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:21:37.941743 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.941719    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" (UID: "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:21:37.941840 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:37.941798    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw" (OuterVolumeSpecName: "kube-api-access-wplcw") pod "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" (UID: "2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4"). InnerVolumeSpecName "kube-api-access-wplcw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:21:38.040643 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.040539    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:38.040643 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.040577    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wplcw\" (UniqueName: \"kubernetes.io/projected/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-kube-api-access-wplcw\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:38.040643 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.040591    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:21:38.346255 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.346155    2578 generic.go:356] "Generic (PLEG): container finished" podID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" containerID="dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385" exitCode=0
Jul 09 15:21:38.346255 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.346202    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"
Jul 09 15:21:38.346255 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.346240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" event={"ID":"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4","Type":"ContainerDied","Data":"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"}
Jul 09 15:21:38.346797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.346295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc" event={"ID":"2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4","Type":"ContainerDied","Data":"093c92a3f32dafe1e68388833697acdaadcf9aab8eae2648cd8e32f49408a3f3"}
Jul 09 15:21:38.346797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.346323    2578 scope.go:117] "RemoveContainer" containerID="dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"
Jul 09 15:21:38.355719 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.355701    2578 scope.go:117] "RemoveContainer" containerID="dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"
Jul 09 15:21:38.355958 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:21:38.355940    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385\": container with ID starting with dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385 not found: ID does not exist" containerID="dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"
Jul 09 15:21:38.356024 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.355970    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385"} err="failed to get container status \"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385\": rpc error: code = NotFound desc = could not find container \"dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385\": container with ID starting with dfcf13f4419f0e4c0303dc1a9afdc6575b969c5a9a405d14795474d2368e9385 not found: ID does not exist"
Jul 09 15:21:38.365237 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.365208    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:38.372211 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:38.372189    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-derive-69810dc0-7c647b696c-jl9zc"]
Jul 09 15:21:39.743540 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:39.743508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:40.123549 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:40.123470    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" path="/var/lib/kubelet/pods/2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4/volumes"
Jul 09 15:21:43.685619 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:43.685580    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:43.762839 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:43.762801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:44.203115 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:44.203081    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:44.303791 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:44.303755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:44.402214 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:44.402176    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:46.044697 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:46.044659    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:54.224781 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:54.224745    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:21:54.293892 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:21:54.293854    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:18.777170 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:18.777126    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:24.615890 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:24.615839    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:24.681090 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:24.681052    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:24.776743 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:24.776703    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:24.869976 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:24.869890    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:40.849210 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:40.849175    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:47.315321 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:47.315276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:47.422482 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:47.422427    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:47.514689 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:47.514656    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:58.107348 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:58.107310    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:22:58.998177 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:22:58.998129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.370328 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:05.370293    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.470213 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:05.470186    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.570033 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:05.569974    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:05.670299 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:05.670209    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:06.527318 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:06.527285    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:06.624591 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:06.624556    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:06.723784 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:06.723743    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:08.472839 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:08.472803    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:14.543181 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:14.543147    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:14.643947 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:14.643914    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:15.275714 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:15.275677    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:21.595262 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:21.595224    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:21.695909 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:21.695880    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:21.867905 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:21.867818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:22.317388 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:22.317351    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:22.749058 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:22.749026    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:25.590564 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.590525    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:25.675259 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.675226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:25.676905 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.676879    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:25.677450 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.677415    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" containerName="maas-api"
Jul 09 15:23:25.677450 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.677440    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" containerName="maas-api"
Jul 09 15:23:25.677591 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.677536    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ddbf47c-7796-44e9-a94a-dd4dafe7e2b4" containerName="maas-api"
Jul 09 15:23:25.680754 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.680738    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.683749 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.683730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-8d76c514-serving-cert\""
Jul 09 15:23:25.692688 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.692669    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:25.757946 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.757921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.758129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.757971    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s46gh\" (UniqueName: \"kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.758129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.758112    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.848005 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.847909    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:25.859015 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.858969    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.859200 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.859027    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s46gh\" (UniqueName: \"kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.859200 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.859082    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.859200 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:23:25.859198    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-serving-cert: secret "maas-api-e2e-mt-8d76c514-serving-cert" not found
Jul 09 15:23:25.859396 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:23:25.859265    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls podName:4a883baf-370b-46f3-81a4-82fdda0e6810 nodeName:}" failed. No retries permitted until 2026-07-09 15:23:26.359247489 +0000 UTC m=+1696.774432549 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls") pod "maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" (UID: "4a883baf-370b-46f3-81a4-82fdda0e6810") : secret "maas-api-e2e-mt-8d76c514-serving-cert" not found
Jul 09 15:23:25.859726 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.859703    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:25.868661 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:25.868630    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s46gh\" (UniqueName: \"kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:26.121195 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.121097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:26.220778 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.220744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:26.320622 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.320597    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:26.363811 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.363775    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:26.366270 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.366243    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") pod \"maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:26.591303 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.591266    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:26.728690 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.728664    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:26.730524 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:23:26.730496    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a883baf_370b_46f3_81a4_82fdda0e6810.slice/crio-3c004337ab2e93f9a27f88d944e2109fd4caf5d527606e3db53a79ef0f4df07d WatchSource:0}: Error finding container 3c004337ab2e93f9a27f88d944e2109fd4caf5d527606e3db53a79ef0f4df07d: Status 404 returned error can't find the container with id 3c004337ab2e93f9a27f88d944e2109fd4caf5d527606e3db53a79ef0f4df07d
Jul 09 15:23:26.758005 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.757969    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:26.944644 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:26.944565    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" event={"ID":"4a883baf-370b-46f3-81a4-82fdda0e6810","Type":"ContainerStarted","Data":"3c004337ab2e93f9a27f88d944e2109fd4caf5d527606e3db53a79ef0f4df07d"}
Jul 09 15:23:27.952100 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:27.952059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" event={"ID":"4a883baf-370b-46f3-81a4-82fdda0e6810","Type":"ContainerStarted","Data":"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"}
Jul 09 15:23:27.952472 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:27.952132    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:27.975952 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:27.975901    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" podStartSLOduration=2.332544151 podStartE2EDuration="2.975886194s" totalImagesPullingTime="643.342043ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:23:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:23:27.973520927 +0000 UTC m=+1698.388706004" watchObservedRunningTime="2026-07-09 15:23:27.975886194 +0000 UTC m=+1698.391071270"
Jul 09 15:23:30.058807 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:30.058770    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:30.809448 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:30.809415    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:30.908983 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:30.908951    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:31.299523 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:31.299492    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:33.969755 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:33.969727    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:37.355549 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:37.355514    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:37.452735 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:37.452700    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:37.818205 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:37.818161    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:38.218628 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.218597    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:38.218829 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.218806    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" podUID="4a883baf-370b-46f3-81a4-82fdda0e6810" containerName="maas-api" containerID="cri-o://59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08" gracePeriod=30
Jul 09 15:23:38.233368 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.233286    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:38.299311 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.299275    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:38.464159 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.464130    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:38.569043 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.568972    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s46gh\" (UniqueName: \"kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh\") pod \"4a883baf-370b-46f3-81a4-82fdda0e6810\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") "
Jul 09 15:23:38.569177 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.569065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca\") pod \"4a883baf-370b-46f3-81a4-82fdda0e6810\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") "
Jul 09 15:23:38.569177 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.569111    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") pod \"4a883baf-370b-46f3-81a4-82fdda0e6810\" (UID: \"4a883baf-370b-46f3-81a4-82fdda0e6810\") "
Jul 09 15:23:38.569475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.569446    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "4a883baf-370b-46f3-81a4-82fdda0e6810" (UID: "4a883baf-370b-46f3-81a4-82fdda0e6810"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:23:38.571309 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.571283    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh" (OuterVolumeSpecName: "kube-api-access-s46gh") pod "4a883baf-370b-46f3-81a4-82fdda0e6810" (UID: "4a883baf-370b-46f3-81a4-82fdda0e6810"). InnerVolumeSpecName "kube-api-access-s46gh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:23:38.571411 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.571375    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "4a883baf-370b-46f3-81a4-82fdda0e6810" (UID: "4a883baf-370b-46f3-81a4-82fdda0e6810"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:23:38.670733 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.670707    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s46gh\" (UniqueName: \"kubernetes.io/projected/4a883baf-370b-46f3-81a4-82fdda0e6810-kube-api-access-s46gh\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:23:38.670733 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.670729    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/4a883baf-370b-46f3-81a4-82fdda0e6810-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:23:38.670905 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:38.670743    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4a883baf-370b-46f3-81a4-82fdda0e6810-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:23:39.019831 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.019801    2578 generic.go:356] "Generic (PLEG): container finished" podID="4a883baf-370b-46f3-81a4-82fdda0e6810" containerID="59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08" exitCode=0
Jul 09 15:23:39.020016 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.019852    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"
Jul 09 15:23:39.020016 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.019889    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" event={"ID":"4a883baf-370b-46f3-81a4-82fdda0e6810","Type":"ContainerDied","Data":"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"}
Jul 09 15:23:39.020016 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.019941    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw" event={"ID":"4a883baf-370b-46f3-81a4-82fdda0e6810","Type":"ContainerDied","Data":"3c004337ab2e93f9a27f88d944e2109fd4caf5d527606e3db53a79ef0f4df07d"}
Jul 09 15:23:39.020016 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.019962    2578 scope.go:117] "RemoveContainer" containerID="59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"
Jul 09 15:23:39.029356 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.029338    2578 scope.go:117] "RemoveContainer" containerID="59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"
Jul 09 15:23:39.029604 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:23:39.029586    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08\": container with ID starting with 59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08 not found: ID does not exist" containerID="59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"
Jul 09 15:23:39.029656 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.029615    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08"} err="failed to get container status \"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08\": rpc error: code = NotFound desc = could not find container \"59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08\": container with ID starting with 59a76b5f4438fc46e3c5fb99d99251cdc95e47ab770470e63015eb5d187aaf08 not found: ID does not exist"
Jul 09 15:23:39.050894 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.050871    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:39.053088 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:39.053068    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-8d76c514-58fd9c9d58-cwjrw"]
Jul 09 15:23:40.129406 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:40.129372    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4a883baf-370b-46f3-81a4-82fdda0e6810" path="/var/lib/kubelet/pods/4a883baf-370b-46f3-81a4-82fdda0e6810/volumes"
Jul 09 15:23:44.568024 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:44.567972    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:44.641504 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:44.641464    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:44.863715 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:44.863639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:45.253960 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:45.253908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:46.799723 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:46.799686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:46.901773 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:46.901744    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:51.663471 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:51.663435    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:51.767574 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:51.767521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:51.877196 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:51.877158    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:52.068716 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:52.068685    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:59.758521 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:59.758456    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:23:59.836936 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:23:59.836897    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:05.401593 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:05.401562    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:05.747480 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:05.747442    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:05.923556 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:05.923517    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:08.802611 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.802570    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:08.803119 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.803102    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4a883baf-370b-46f3-81a4-82fdda0e6810" containerName="maas-api"
Jul 09 15:24:08.803190 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.803121    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4a883baf-370b-46f3-81a4-82fdda0e6810" containerName="maas-api"
Jul 09 15:24:08.803229 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.803201    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4a883baf-370b-46f3-81a4-82fdda0e6810" containerName="maas-api"
Jul 09 15:24:08.806292 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.806273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:08.808940 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.808921    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-mt-eebed0bf-serving-cert\""
Jul 09 15:24:08.823861 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.823839    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:08.838215 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.838192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:08.922455 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.922424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:08.922628 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.922545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:08.922713 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.922633    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pp7pj\" (UniqueName: \"kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:08.938040 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:08.938010    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:09.023444 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.023414    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.023584 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.023466    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pp7pj\" (UniqueName: \"kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.023584 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.023508    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.023707 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:24:09.023579    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-serving-cert: secret "maas-api-e2e-mt-eebed0bf-serving-cert" not found
Jul 09 15:24:09.023707 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:24:09.023656    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls podName:c1db331a-996a-4820-81c8-fe85c463e186 nodeName:}" failed. No retries permitted until 2026-07-09 15:24:09.523632135 +0000 UTC m=+1739.938817192 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls") pod "maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" (UID: "c1db331a-996a-4820-81c8-fe85c463e186") : secret "maas-api-e2e-mt-eebed0bf-serving-cert" not found
Jul 09 15:24:09.024151 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.024132    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.056156 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.056100    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pp7pj\" (UniqueName: \"kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.441464 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.441371    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:09.529489 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.529458    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.532086 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.532062    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") pod \"maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") " pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.549608 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.549579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:09.657831 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.657795    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:09.716550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.716525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:09.864584 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:09.864550    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:09.865549 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:24:09.865518    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1db331a_996a_4820_81c8_fe85c463e186.slice/crio-c166cb6fc5845aff0452b2fdfdf6715eb3c61d4eaa24021802b32db0c783ec42 WatchSource:0}: Error finding container c166cb6fc5845aff0452b2fdfdf6715eb3c61d4eaa24021802b32db0c783ec42: Status 404 returned error can't find the container with id c166cb6fc5845aff0452b2fdfdf6715eb3c61d4eaa24021802b32db0c783ec42
Jul 09 15:24:10.183934 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:10.183851    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" event={"ID":"c1db331a-996a-4820-81c8-fe85c463e186","Type":"ContainerStarted","Data":"c166cb6fc5845aff0452b2fdfdf6715eb3c61d4eaa24021802b32db0c783ec42"}
Jul 09 15:24:11.191497 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:11.191459    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" event={"ID":"c1db331a-996a-4820-81c8-fe85c463e186","Type":"ContainerStarted","Data":"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"}
Jul 09 15:24:11.191883 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:11.191589    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:11.213441 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:11.213391    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" podStartSLOduration=2.840875697 podStartE2EDuration="3.213378043s" totalImagesPullingTime="372.502346ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:24:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:24:11.210902146 +0000 UTC m=+1741.626087222" watchObservedRunningTime="2026-07-09 15:24:11.213378043 +0000 UTC m=+1741.628563162"
Jul 09 15:24:13.253483 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:13.253443    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:17.202130 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:17.202103    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:29.882149 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:29.882101    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:29.981774 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:29.981706    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:30.652960 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:30.652918    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:30.752804 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:30.752756    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:31.965103 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:31.965072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:51.096956 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.096917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:51.451459 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.451429    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:51.451699 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.451669    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" podUID="c1db331a-996a-4820-81c8-fe85c463e186" containerName="maas-api" containerID="cri-o://5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d" gracePeriod=30
Jul 09 15:24:51.533248 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.533216    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:24:51.705074 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.705013    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:51.893614 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.893587    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") pod \"c1db331a-996a-4820-81c8-fe85c463e186\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") "
Jul 09 15:24:51.893782 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.893630    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pp7pj\" (UniqueName: \"kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj\") pod \"c1db331a-996a-4820-81c8-fe85c463e186\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") "
Jul 09 15:24:51.893782 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.893691    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca\") pod \"c1db331a-996a-4820-81c8-fe85c463e186\" (UID: \"c1db331a-996a-4820-81c8-fe85c463e186\") "
Jul 09 15:24:51.894133 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.894104    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c1db331a-996a-4820-81c8-fe85c463e186" (UID: "c1db331a-996a-4820-81c8-fe85c463e186"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:24:51.895901 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.895867    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj" (OuterVolumeSpecName: "kube-api-access-pp7pj") pod "c1db331a-996a-4820-81c8-fe85c463e186" (UID: "c1db331a-996a-4820-81c8-fe85c463e186"). InnerVolumeSpecName "kube-api-access-pp7pj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:24:51.896039 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.895921    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c1db331a-996a-4820-81c8-fe85c463e186" (UID: "c1db331a-996a-4820-81c8-fe85c463e186"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:24:51.994670 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.994607    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pp7pj\" (UniqueName: \"kubernetes.io/projected/c1db331a-996a-4820-81c8-fe85c463e186-kube-api-access-pp7pj\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:24:51.994670 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.994631    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c1db331a-996a-4820-81c8-fe85c463e186-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:24:51.994670 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:51.994642    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c1db331a-996a-4820-81c8-fe85c463e186-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:24:52.410088 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.409978    2578 generic.go:356] "Generic (PLEG): container finished" podID="c1db331a-996a-4820-81c8-fe85c463e186" containerID="5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d" exitCode=0
Jul 09 15:24:52.410088 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.410052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" event={"ID":"c1db331a-996a-4820-81c8-fe85c463e186","Type":"ContainerDied","Data":"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"}
Jul 09 15:24:52.410530 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.410090    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d" event={"ID":"c1db331a-996a-4820-81c8-fe85c463e186","Type":"ContainerDied","Data":"c166cb6fc5845aff0452b2fdfdf6715eb3c61d4eaa24021802b32db0c783ec42"}
Jul 09 15:24:52.410530 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.410110    2578 scope.go:117] "RemoveContainer" containerID="5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"
Jul 09 15:24:52.410530 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.410053    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"
Jul 09 15:24:52.419492 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.419472    2578 scope.go:117] "RemoveContainer" containerID="5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"
Jul 09 15:24:52.419746 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:24:52.419723    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d\": container with ID starting with 5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d not found: ID does not exist" containerID="5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"
Jul 09 15:24:52.419793 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.419760    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d"} err="failed to get container status \"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d\": rpc error: code = NotFound desc = could not find container \"5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d\": container with ID starting with 5e3099f23c489cd81741bf20785a55815aa8521c5a36f35dc7aa91de5aa1125d not found: ID does not exist"
Jul 09 15:24:52.429360 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.429337    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:52.433360 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:52.433333    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-mt-eebed0bf-bddbc567f-swg8d"]
Jul 09 15:24:54.124353 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:54.124319    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1db331a-996a-4820-81c8-fe85c463e186" path="/var/lib/kubelet/pods/c1db331a-996a-4820-81c8-fe85c463e186/volumes"
Jul 09 15:24:57.223194 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:24:57.223156    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:02.298031 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:02.297924    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:10.197864 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:10.197835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:25:10.203934 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:10.203908    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:25:30.359627 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:30.359587    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:30.428975 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:30.428939    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:38.653495 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:38.653455    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:39.497019 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:39.496959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:45.389631 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:45.389590    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:51.335661 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:51.335622    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:51.408818 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:51.408777    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:51.646177 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:51.646095    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:53.022362 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:53.022316    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:53.121340 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:53.121307    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:53.221931 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:53.221892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:54.044002 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:54.043959    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:54.134829 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:54.134797    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:54.235127 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:54.235096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:25:55.775167 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:25:55.775130    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:02.302686 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:02.302648    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:02.405394 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:02.405365    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:03.084231 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:03.084194    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:09.521117 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:09.521085    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:09.629126 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:09.629091    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:09.724366 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:09.724329    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:20.303777 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:20.303739    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:20.673903 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:20.673812    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:41.710875 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:41.710793    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:48.323324 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:48.323291    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:48.446126 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:48.446090    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:48.645900 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:48.645818    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:49.065849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:49.065817    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:49.230124 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:49.230093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:52.529495 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.529457    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:52.588151 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.588123    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:26:52.588642 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.588624    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1db331a-996a-4820-81c8-fe85c463e186" containerName="maas-api"
Jul 09 15:26:52.588642 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.588643    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1db331a-996a-4820-81c8-fe85c463e186" containerName="maas-api"
Jul 09 15:26:52.588761 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.588710    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1db331a-996a-4820-81c8-fe85c463e186" containerName="maas-api"
Jul 09 15:26:52.592017 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.591999    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.595690 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.595672    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-476308-serving-cert\""
Jul 09 15:26:52.613222 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.613190    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:26:52.638350 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.638331    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:52.728293 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.728265    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.728412 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.728322    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.728412 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.728352    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkv79\" (UniqueName: \"kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.775303 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.775276    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:52.829463 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.829404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.829463 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.829435    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkv79\" (UniqueName: \"kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.829591 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.829492    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.829642 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:26:52.829601    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-serving-cert: secret "maas-api-e2e-inf-a-476308-serving-cert" not found
Jul 09 15:26:52.829691 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:26:52.829683    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls podName:5567c684-af6b-4e2f-b409-9ca62e86c30e nodeName:}" failed. No retries permitted until 2026-07-09 15:26:53.329666612 +0000 UTC m=+1903.744851681 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls") pod "maas-api-e2e-inf-a-476308-679555b-fhjc4" (UID: "5567c684-af6b-4e2f-b409-9ca62e86c30e") : secret "maas-api-e2e-inf-a-476308-serving-cert" not found
Jul 09 15:26:52.830116 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.830098    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:52.841743 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:52.841713    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkv79\" (UniqueName: \"kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:53.188012 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.187903    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:53.290718 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.290663    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:53.333718 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.333678    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:53.336337 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.336315    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") pod \"maas-api-e2e-inf-a-476308-679555b-fhjc4\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:53.502612 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.502578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:53.640750 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.640710    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:26:53.641579 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:26:53.641552    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5567c684_af6b_4e2f_b409_9ca62e86c30e.slice/crio-cf1c6e8732f4a1d87d2eac10e800c71d27873998ac5778940c49b90b324b344d WatchSource:0}: Error finding container cf1c6e8732f4a1d87d2eac10e800c71d27873998ac5778940c49b90b324b344d: Status 404 returned error can't find the container with id cf1c6e8732f4a1d87d2eac10e800c71d27873998ac5778940c49b90b324b344d
Jul 09 15:26:53.643025 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:53.642982    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 09 15:26:54.063092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:54.063061    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" event={"ID":"5567c684-af6b-4e2f-b409-9ca62e86c30e","Type":"ContainerStarted","Data":"cf1c6e8732f4a1d87d2eac10e800c71d27873998ac5778940c49b90b324b344d"}
Jul 09 15:26:55.072408 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:55.072372    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" event={"ID":"5567c684-af6b-4e2f-b409-9ca62e86c30e","Type":"ContainerStarted","Data":"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"}
Jul 09 15:26:55.072828 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:55.072478    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:26:55.096444 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:55.096401    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" podStartSLOduration=2.415771378 podStartE2EDuration="3.096386722s" totalImagesPullingTime="680.615344ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:55.094763847 +0000 UTC m=+1905.509948923" watchObservedRunningTime="2026-07-09 15:26:55.096386722 +0000 UTC m=+1905.511571796"
Jul 09 15:26:57.064655 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:57.064609    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:57.464956 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:57.464917    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:57.849200 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:57.849112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:26:57.949492 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:26:57.949445    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:01.062435 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.062399    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:01.083531 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.083501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:27:01.161526 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.161478    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:01.167899 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.167874    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:27:01.171729 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.171710    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.174583 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.174562    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-da3a23-serving-cert\""
Jul 09 15:27:01.184483 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.184461    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:27:01.250926 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.250892    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:01.301085 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.301061    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.301221 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.301098    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.301221 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.301120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.355744 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.355658    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:01.401672 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.401641    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.401672 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.401672    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.401886 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.401742    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.402431 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.402357    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.404168 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.404117    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.420033 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.419979    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f\") pod \"maas-api-e2e-inf-b-da3a23-848f667cf-jtngf\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.485899 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.485876    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:01.837473 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.837446    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:27:01.839202 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:27:01.839168    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d03ed74_7028_47f7_a704_be7258f4a90a.slice/crio-1749f770f21975f7d255bcfa2e8ced8f92fd91e80ac6eb30c78541211108b4d4 WatchSource:0}: Error finding container 1749f770f21975f7d255bcfa2e8ced8f92fd91e80ac6eb30c78541211108b4d4: Status 404 returned error can't find the container with id 1749f770f21975f7d255bcfa2e8ced8f92fd91e80ac6eb30c78541211108b4d4
Jul 09 15:27:01.950595 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:01.950563    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:02.088433 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:02.088341    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:02.109285 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:02.109247    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" event={"ID":"3d03ed74-7028-47f7-a704-be7258f4a90a","Type":"ContainerStarted","Data":"1749f770f21975f7d255bcfa2e8ced8f92fd91e80ac6eb30c78541211108b4d4"}
Jul 09 15:27:03.116064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:03.116030    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" event={"ID":"3d03ed74-7028-47f7-a704-be7258f4a90a","Type":"ContainerStarted","Data":"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"}
Jul 09 15:27:03.116468 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:03.116120    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:03.138326 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:03.138279    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" podStartSLOduration=1.517240973 podStartE2EDuration="2.138265537s" totalImagesPullingTime="621.024564ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:27:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:03.136557505 +0000 UTC m=+1913.551742580" watchObservedRunningTime="2026-07-09 15:27:03.138265537 +0000 UTC m=+1913.553450612"
Jul 09 15:27:05.528354 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:05.528317    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:09.126903 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:09.126875    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:27:14.038187 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:14.038129    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:14.139301 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:14.139272    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:22.823857 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:22.823822    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:22.914835 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:22.914775    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:25.439207 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:25.439172    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:27:52.644457 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:27:52.644408    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:15.444980 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:15.444948    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:15.647324 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:15.647284    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:15.816720 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:15.816684    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:16.284062 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.284015    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:16.383236 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.383200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:16.508318 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.508282    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:16.601195 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.601124    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:28:16.601383 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.601359    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" podUID="5567c684-af6b-4e2f-b409-9ca62e86c30e" containerName="maas-api" containerID="cri-o://715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e" gracePeriod=30
Jul 09 15:28:16.642242 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.642200    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:16.856550 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.856498    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:28:16.960944 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.960914    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca\") pod \"5567c684-af6b-4e2f-b409-9ca62e86c30e\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") "
Jul 09 15:28:16.961109 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.960955    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") pod \"5567c684-af6b-4e2f-b409-9ca62e86c30e\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") "
Jul 09 15:28:16.961109 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.961018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkv79\" (UniqueName: \"kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79\") pod \"5567c684-af6b-4e2f-b409-9ca62e86c30e\" (UID: \"5567c684-af6b-4e2f-b409-9ca62e86c30e\") "
Jul 09 15:28:16.961386 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.961357    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5567c684-af6b-4e2f-b409-9ca62e86c30e" (UID: "5567c684-af6b-4e2f-b409-9ca62e86c30e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:28:16.963247 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.963225    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79" (OuterVolumeSpecName: "kube-api-access-bkv79") pod "5567c684-af6b-4e2f-b409-9ca62e86c30e" (UID: "5567c684-af6b-4e2f-b409-9ca62e86c30e"). InnerVolumeSpecName "kube-api-access-bkv79". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:28:16.963318 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:16.963259    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5567c684-af6b-4e2f-b409-9ca62e86c30e" (UID: "5567c684-af6b-4e2f-b409-9ca62e86c30e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:28:17.062677 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.062642    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkv79\" (UniqueName: \"kubernetes.io/projected/5567c684-af6b-4e2f-b409-9ca62e86c30e-kube-api-access-bkv79\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:28:17.062677 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.062671    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5567c684-af6b-4e2f-b409-9ca62e86c30e-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:28:17.062677 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.062684    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5567c684-af6b-4e2f-b409-9ca62e86c30e-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:28:17.518923 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.518890    2578 generic.go:356] "Generic (PLEG): container finished" podID="5567c684-af6b-4e2f-b409-9ca62e86c30e" containerID="715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e" exitCode=0
Jul 09 15:28:17.519339 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.518939    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"
Jul 09 15:28:17.519339 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.518977    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" event={"ID":"5567c684-af6b-4e2f-b409-9ca62e86c30e","Type":"ContainerDied","Data":"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"}
Jul 09 15:28:17.519339 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.519054    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4" event={"ID":"5567c684-af6b-4e2f-b409-9ca62e86c30e","Type":"ContainerDied","Data":"cf1c6e8732f4a1d87d2eac10e800c71d27873998ac5778940c49b90b324b344d"}
Jul 09 15:28:17.519339 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.519076    2578 scope.go:117] "RemoveContainer" containerID="715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"
Jul 09 15:28:17.528359 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.528343    2578 scope.go:117] "RemoveContainer" containerID="715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"
Jul 09 15:28:17.528607 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:28:17.528589    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e\": container with ID starting with 715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e not found: ID does not exist" containerID="715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"
Jul 09 15:28:17.528660 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.528616    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e"} err="failed to get container status \"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e\": rpc error: code = NotFound desc = could not find container \"715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e\": container with ID starting with 715dda65c5582f0fc8d05eb206d3de734b401aa27448c954ba017cc0b7899e5e not found: ID does not exist"
Jul 09 15:28:17.543111 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.543091    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:28:17.548090 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:17.548068    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-476308-679555b-fhjc4"]
Jul 09 15:28:18.123725 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:18.123683    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5567c684-af6b-4e2f-b409-9ca62e86c30e" path="/var/lib/kubelet/pods/5567c684-af6b-4e2f-b409-9ca62e86c30e/volumes"
Jul 09 15:28:21.316327 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:21.316295    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:34.330079 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:34.330037    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:38.886297 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:38.886260    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:38.994035 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:38.993983    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:40.843615 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:40.843579    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:58.672720 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:58.672686    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:59.109122 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:59.109086    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:59.461786 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:59.461751    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:28:59.917609 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:28:59.917522    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:00.017943 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.017908    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:00.118344 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.118308    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:00.256951 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.256919    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:29:00.257191 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.257163    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" podUID="3d03ed74-7028-47f7-a704-be7258f4a90a" containerName="maas-api" containerID="cri-o://14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15" gracePeriod=30
Jul 09 15:29:00.283973 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.283944    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:00.505947 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.505926    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:29:00.640257 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.640172    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f\") pod \"3d03ed74-7028-47f7-a704-be7258f4a90a\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") "
Jul 09 15:29:00.640443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.640305    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls\") pod \"3d03ed74-7028-47f7-a704-be7258f4a90a\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") "
Jul 09 15:29:00.640443 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.640328    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca\") pod \"3d03ed74-7028-47f7-a704-be7258f4a90a\" (UID: \"3d03ed74-7028-47f7-a704-be7258f4a90a\") "
Jul 09 15:29:00.640731 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.640705    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "3d03ed74-7028-47f7-a704-be7258f4a90a" (UID: "3d03ed74-7028-47f7-a704-be7258f4a90a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:00.642738 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.642713    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "3d03ed74-7028-47f7-a704-be7258f4a90a" (UID: "3d03ed74-7028-47f7-a704-be7258f4a90a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:00.642845 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.642785    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f" (OuterVolumeSpecName: "kube-api-access-zqk4f") pod "3d03ed74-7028-47f7-a704-be7258f4a90a" (UID: "3d03ed74-7028-47f7-a704-be7258f4a90a"). InnerVolumeSpecName "kube-api-access-zqk4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:00.741490 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.741468    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zqk4f\" (UniqueName: \"kubernetes.io/projected/3d03ed74-7028-47f7-a704-be7258f4a90a-kube-api-access-zqk4f\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:00.741490 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.741492    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/3d03ed74-7028-47f7-a704-be7258f4a90a-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:00.741648 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.741502    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/3d03ed74-7028-47f7-a704-be7258f4a90a-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:00.748150 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.748112    2578 generic.go:356] "Generic (PLEG): container finished" podID="3d03ed74-7028-47f7-a704-be7258f4a90a" containerID="14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15" exitCode=0
Jul 09 15:29:00.748269 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.748181    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"
Jul 09 15:29:00.748337 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.748184    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" event={"ID":"3d03ed74-7028-47f7-a704-be7258f4a90a","Type":"ContainerDied","Data":"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"}
Jul 09 15:29:00.748390 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.748340    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf" event={"ID":"3d03ed74-7028-47f7-a704-be7258f4a90a","Type":"ContainerDied","Data":"1749f770f21975f7d255bcfa2e8ced8f92fd91e80ac6eb30c78541211108b4d4"}
Jul 09 15:29:00.748390 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.748362    2578 scope.go:117] "RemoveContainer" containerID="14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"
Jul 09 15:29:00.758284 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.758266    2578 scope.go:117] "RemoveContainer" containerID="14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"
Jul 09 15:29:00.758540 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:00.758518    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15\": container with ID starting with 14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15 not found: ID does not exist" containerID="14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"
Jul 09 15:29:00.758618 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.758551    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15"} err="failed to get container status \"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15\": rpc error: code = NotFound desc = could not find container \"14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15\": container with ID starting with 14aa81dfad24eefbcd472ba4c1997f13d903cbeb7167cb5f2fbd500cc5032a15 not found: ID does not exist"
Jul 09 15:29:00.771317 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.771292    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:29:00.776148 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:00.776128    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-da3a23-848f667cf-jtngf"]
Jul 09 15:29:02.123528 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:02.123494    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3d03ed74-7028-47f7-a704-be7258f4a90a" path="/var/lib/kubelet/pods/3d03ed74-7028-47f7-a704-be7258f4a90a/volumes"
Jul 09 15:29:05.878057 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:05.878018    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:05.979138 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:05.979110    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:06.198453 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:06.198375    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:06.780711 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:06.780680    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:07.105734 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:07.105650    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:09.627306 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:09.627271    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:10.118302 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.118267    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:10.205007 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.204958    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:10.205421 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205402    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5567c684-af6b-4e2f-b409-9ca62e86c30e" containerName="maas-api"
Jul 09 15:29:10.205475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205427    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="5567c684-af6b-4e2f-b409-9ca62e86c30e" containerName="maas-api"
Jul 09 15:29:10.205475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205457    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3d03ed74-7028-47f7-a704-be7258f4a90a" containerName="maas-api"
Jul 09 15:29:10.205475 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205468    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="3d03ed74-7028-47f7-a704-be7258f4a90a" containerName="maas-api"
Jul 09 15:29:10.205581 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205564    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="5567c684-af6b-4e2f-b409-9ca62e86c30e" containerName="maas-api"
Jul 09 15:29:10.205581 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.205575    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="3d03ed74-7028-47f7-a704-be7258f4a90a" containerName="maas-api"
Jul 09 15:29:10.209709 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.209630    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:10.210092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.210077    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.213629 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.213609    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-227dc3-serving-cert\""
Jul 09 15:29:10.220689 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.220665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:10.289559 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.289528    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:10.331237 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.331210    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.331354 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.331270    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.331354 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.331304    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xs66t\" (UniqueName: \"kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.389925 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.389853    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:10.432081 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.432055    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.432261 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.432097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.432261 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.432124    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xs66t\" (UniqueName: \"kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.432763 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.432742    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.434704 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.434681    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.443132 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.443108    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xs66t\" (UniqueName: \"kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t\") pod \"maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.520318 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.520284    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:10.683242 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.683215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:10.684126 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:29:10.684099    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode85e773b_7ddc_48a0_a344_aa0332f4bfe2.slice/crio-6030214d3357528c3d39e4f9a72edcf3096e016c409934520c59304eda5a6c96 WatchSource:0}: Error finding container 6030214d3357528c3d39e4f9a72edcf3096e016c409934520c59304eda5a6c96: Status 404 returned error can't find the container with id 6030214d3357528c3d39e4f9a72edcf3096e016c409934520c59304eda5a6c96
Jul 09 15:29:10.805009 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.804955    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" event={"ID":"e85e773b-7ddc-48a0-a344-aa0332f4bfe2","Type":"ContainerStarted","Data":"6030214d3357528c3d39e4f9a72edcf3096e016c409934520c59304eda5a6c96"}
Jul 09 15:29:10.973126 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:10.973094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:11.072680 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:11.072641    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:11.812061 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:11.812022    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" event={"ID":"e85e773b-7ddc-48a0-a344-aa0332f4bfe2","Type":"ContainerStarted","Data":"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"}
Jul 09 15:29:11.812517 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:11.812110    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:11.832634 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:11.832587    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" podStartSLOduration=1.400230755 podStartE2EDuration="1.832573089s" totalImagesPullingTime="432.342334ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:11.830546959 +0000 UTC m=+2042.245732036" watchObservedRunningTime="2026-07-09 15:29:11.832573089 +0000 UTC m=+2042.247758175"
Jul 09 15:29:14.670404 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:14.670353    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:15.158930 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:15.158887    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:15.480250 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:15.480220    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:16.471050 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:16.471016    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:17.822518 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:17.822483    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:18.667918 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.667886    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:18.764099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.764070    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:18.863758 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.863726    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:18.867462 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.867437    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:18.872626 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.872605    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-e415c5-serving-cert\""
Jul 09 15:29:18.878152 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:18.878132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:19.017869 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.017837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.018073 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.017884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5vtw\" (UniqueName: \"kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.018073 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.017912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.080163 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.080133    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:19.119189 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.119163    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5vtw\" (UniqueName: \"kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.119312 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.119200    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.119312 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.119267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.119926 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.119865    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.121747 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.121725    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.140802 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.140783    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5vtw\" (UniqueName: \"kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw\") pod \"maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.179545 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.179522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:19.185766 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.185729    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:19.330610 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.330587    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:19.332729 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:29:19.332700    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9cf57b48_328f_4d96_84a7_55a7e9a26d21.slice/crio-f680eed91431ff3a2a4ee7816ee17bcb7471878bc7d49ee53ad73c2230aef11f WatchSource:0}: Error finding container f680eed91431ff3a2a4ee7816ee17bcb7471878bc7d49ee53ad73c2230aef11f: Status 404 returned error can't find the container with id f680eed91431ff3a2a4ee7816ee17bcb7471878bc7d49ee53ad73c2230aef11f
Jul 09 15:29:19.458636 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.458584    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:19.558189 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.558096    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:19.859097 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:19.859071    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" event={"ID":"9cf57b48-328f-4d96-84a7-55a7e9a26d21","Type":"ContainerStarted","Data":"f680eed91431ff3a2a4ee7816ee17bcb7471878bc7d49ee53ad73c2230aef11f"}
Jul 09 15:29:20.865719 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:20.865682    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" event={"ID":"9cf57b48-328f-4d96-84a7-55a7e9a26d21","Type":"ContainerStarted","Data":"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"}
Jul 09 15:29:20.866150 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:20.865752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:20.898108 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:20.898061    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" podStartSLOduration=2.411319018 podStartE2EDuration="2.898045277s" totalImagesPullingTime="486.726259ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:20.897135602 +0000 UTC m=+2051.312320678" watchObservedRunningTime="2026-07-09 15:29:20.898045277 +0000 UTC m=+2051.313230354"
Jul 09 15:29:23.226703 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:23.226651    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:26.878354 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:26.878321    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:30.662266 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:30.662192    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:32.214711 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.214681    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:32.215244 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.214905    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" podUID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" containerName="maas-api" containerID="cri-o://f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec" gracePeriod=30
Jul 09 15:29:32.463828 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.463803    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:32.641664 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.641582    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xs66t\" (UniqueName: \"kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t\") pod \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") "
Jul 09 15:29:32.641664 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.641623    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls\") pod \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") "
Jul 09 15:29:32.641860 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.641694    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca\") pod \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\" (UID: \"e85e773b-7ddc-48a0-a344-aa0332f4bfe2\") "
Jul 09 15:29:32.642152 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.642127    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e85e773b-7ddc-48a0-a344-aa0332f4bfe2" (UID: "e85e773b-7ddc-48a0-a344-aa0332f4bfe2"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:32.643898 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.643868    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e85e773b-7ddc-48a0-a344-aa0332f4bfe2" (UID: "e85e773b-7ddc-48a0-a344-aa0332f4bfe2"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:32.644124 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.643905    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t" (OuterVolumeSpecName: "kube-api-access-xs66t") pod "e85e773b-7ddc-48a0-a344-aa0332f4bfe2" (UID: "e85e773b-7ddc-48a0-a344-aa0332f4bfe2"). InnerVolumeSpecName "kube-api-access-xs66t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:32.674691 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.674666    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:32.742513 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.742486    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:32.742513 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.742508    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xs66t\" (UniqueName: \"kubernetes.io/projected/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-kube-api-access-xs66t\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:32.742646 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.742525    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e85e773b-7ddc-48a0-a344-aa0332f4bfe2-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:32.757259 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.757233    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:32.933102 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.933025    2578 generic.go:356] "Generic (PLEG): container finished" podID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" containerID="f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec" exitCode=0
Jul 09 15:29:32.933102 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.933088    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"
Jul 09 15:29:32.933296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.933117    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" event={"ID":"e85e773b-7ddc-48a0-a344-aa0332f4bfe2","Type":"ContainerDied","Data":"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"}
Jul 09 15:29:32.933296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.933199    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww" event={"ID":"e85e773b-7ddc-48a0-a344-aa0332f4bfe2","Type":"ContainerDied","Data":"6030214d3357528c3d39e4f9a72edcf3096e016c409934520c59304eda5a6c96"}
Jul 09 15:29:32.933296 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.933229    2578 scope.go:117] "RemoveContainer" containerID="f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"
Jul 09 15:29:32.942860 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.942843    2578 scope.go:117] "RemoveContainer" containerID="f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"
Jul 09 15:29:32.943130 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:32.943112    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec\": container with ID starting with f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec not found: ID does not exist" containerID="f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"
Jul 09 15:29:32.943186 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.943139    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec"} err="failed to get container status \"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec\": rpc error: code = NotFound desc = could not find container \"f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec\": container with ID starting with f2e7e955c2d2e71cb84b4569c6ccc78ecfef3f213c7174fb284eb6b9b84ecaec not found: ID does not exist"
Jul 09 15:29:32.958235 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.958208    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:32.962812 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:32.962792    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-227dc3-785d455f8b-jh9ww"]
Jul 09 15:29:34.124269 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:34.124239    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" path="/var/lib/kubelet/pods/e85e773b-7ddc-48a0-a344-aa0332f4bfe2/volumes"
Jul 09 15:29:38.028182 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:38.028145    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.124828 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:38.124790    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.332502 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:38.332413    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:38.735676 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:38.735639    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:39.377134 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.377094    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:39.477488 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.477454    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:39.656129 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.656043    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:39.656570 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.656541    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" podUID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" containerName="maas-api" containerID="cri-o://0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4" gracePeriod=30
Jul 09 15:29:39.667156 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.667132    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:39.905633 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.905610    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:39.975689 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.975656    2578 generic.go:356] "Generic (PLEG): container finished" podID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" containerID="0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4" exitCode=0
Jul 09 15:29:39.975849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.975699    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"
Jul 09 15:29:39.975849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.975746    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" event={"ID":"9cf57b48-328f-4d96-84a7-55a7e9a26d21","Type":"ContainerDied","Data":"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"}
Jul 09 15:29:39.975849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.975792    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l" event={"ID":"9cf57b48-328f-4d96-84a7-55a7e9a26d21","Type":"ContainerDied","Data":"f680eed91431ff3a2a4ee7816ee17bcb7471878bc7d49ee53ad73c2230aef11f"}
Jul 09 15:29:39.975849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.975814    2578 scope.go:117] "RemoveContainer" containerID="0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"
Jul 09 15:29:39.984751 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.984740    2578 scope.go:117] "RemoveContainer" containerID="0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"
Jul 09 15:29:39.985071 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:39.985053    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4\": container with ID starting with 0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4 not found: ID does not exist" containerID="0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"
Jul 09 15:29:39.985137 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:39.985080    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4"} err="failed to get container status \"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4\": rpc error: code = NotFound desc = could not find container \"0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4\": container with ID starting with 0c7979ae6b54bd258039d6a21dbda8d527ae15d9051de416ad8b9ad2e83021f4 not found: ID does not exist"
Jul 09 15:29:40.012474 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.012444    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls\") pod \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") "
Jul 09 15:29:40.012600 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.012482    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca\") pod \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") "
Jul 09 15:29:40.012600 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.012509    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5vtw\" (UniqueName: \"kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw\") pod \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\" (UID: \"9cf57b48-328f-4d96-84a7-55a7e9a26d21\") "
Jul 09 15:29:40.012820 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.012799    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "9cf57b48-328f-4d96-84a7-55a7e9a26d21" (UID: "9cf57b48-328f-4d96-84a7-55a7e9a26d21"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:29:40.014661 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.014641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "9cf57b48-328f-4d96-84a7-55a7e9a26d21" (UID: "9cf57b48-328f-4d96-84a7-55a7e9a26d21"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:29:40.014744 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.014723    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw" (OuterVolumeSpecName: "kube-api-access-z5vtw") pod "9cf57b48-328f-4d96-84a7-55a7e9a26d21" (UID: "9cf57b48-328f-4d96-84a7-55a7e9a26d21"). InnerVolumeSpecName "kube-api-access-z5vtw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:29:40.113510 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.113478    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9cf57b48-328f-4d96-84a7-55a7e9a26d21-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:40.113510 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.113505    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9cf57b48-328f-4d96-84a7-55a7e9a26d21-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:40.113659 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.113515    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5vtw\" (UniqueName: \"kubernetes.io/projected/9cf57b48-328f-4d96-84a7-55a7e9a26d21-kube-api-access-z5vtw\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:29:40.294164 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.294089    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:40.299554 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:40.299531    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-e415c5-7dd6fdbf6f-5rl8l"]
Jul 09 15:29:42.127420 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:42.127387    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" path="/var/lib/kubelet/pods/9cf57b48-328f-4d96-84a7-55a7e9a26d21/volumes"
Jul 09 15:29:45.418278 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:45.418241    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:45.517703 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:45.517670    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:46.026719 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:46.026683    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:46.268126 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:46.268093    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:46.633433 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:46.633404    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:47.104865 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:47.104823    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:49.404644 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.404612    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:49.490594 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.490565    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:49.547254 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547188    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:29:49.547703 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547686    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" containerName="maas-api"
Jul 09 15:29:49.547703 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547705    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" containerName="maas-api"
Jul 09 15:29:49.547849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547729    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" containerName="maas-api"
Jul 09 15:29:49.547849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547735    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" containerName="maas-api"
Jul 09 15:29:49.547849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547787    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="e85e773b-7ddc-48a0-a344-aa0332f4bfe2" containerName="maas-api"
Jul 09 15:29:49.547849 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.547799    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9cf57b48-328f-4d96-84a7-55a7e9a26d21" containerName="maas-api"
Jul 09 15:29:49.550885 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.550868    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.553865 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.553847    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-df6252-serving-cert\""
Jul 09 15:29:49.564270 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.564251    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:29:49.584101 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.584072    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:49.591143 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.591120    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.591271 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.591254    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2pm45\" (UniqueName: \"kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.591338 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.591321    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.692305 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.692236    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.692448 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.692339    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2pm45\" (UniqueName: \"kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.692448 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.692367    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.692577 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:49.692456    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-serving-cert: secret "maas-api-e2e-shared-a-df6252-serving-cert" not found
Jul 09 15:29:49.692577 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:49.692508    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls podName:1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a nodeName:}" failed. No retries permitted until 2026-07-09 15:29:50.192494001 +0000 UTC m=+2080.607679056 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls") pod "maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" (UID: "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a") : secret "maas-api-e2e-shared-a-df6252-serving-cert" not found
Jul 09 15:29:49.692981 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.692958    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.702430 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.702409    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2pm45\" (UniqueName: \"kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:49.850880 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:49.850848    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:50.077594 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.077558    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:50.168897 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.168865    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:50.197329 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.197294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:50.200073 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.200045    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") pod \"maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:50.461291 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.461261    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:50.602158 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:50.602133    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:29:50.604906 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:29:50.604879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ca2e9af_715c_4cb9_8cd9_6f2f8b77582a.slice/crio-687d1bbe156a0780c01e6ad925fd1ee7888c0e4548b549ad8dc611cf0b4e48d7 WatchSource:0}: Error finding container 687d1bbe156a0780c01e6ad925fd1ee7888c0e4548b549ad8dc611cf0b4e48d7: Status 404 returned error can't find the container with id 687d1bbe156a0780c01e6ad925fd1ee7888c0e4548b549ad8dc611cf0b4e48d7
Jul 09 15:29:51.044840 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:51.044808    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" event={"ID":"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a","Type":"ContainerStarted","Data":"687d1bbe156a0780c01e6ad925fd1ee7888c0e4548b549ad8dc611cf0b4e48d7"}
Jul 09 15:29:52.051598 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:52.051554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" event={"ID":"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a","Type":"ContainerStarted","Data":"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"}
Jul 09 15:29:52.051939 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:52.051628    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:52.085931 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:52.085886    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" podStartSLOduration=2.629992376 podStartE2EDuration="3.085871096s" totalImagesPullingTime="455.87872ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:29:52.080814261 +0000 UTC m=+2082.495999338" watchObservedRunningTime="2026-07-09 15:29:52.085871096 +0000 UTC m=+2082.501056172"
Jul 09 15:29:53.881782 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:53.881741    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:54.245064 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:54.245031    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:54.576491 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:54.576400    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:54.786152 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:54.786112    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.850328 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.850290    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.933153 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.933120    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:57.934882 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.934853    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:29:57.938922 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.938903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:57.941493 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.941477    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-19ef0f-serving-cert\""
Jul 09 15:29:57.952878 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.952852    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:29:57.967052 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.967031    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:57.967155 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.967105    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:57.967155 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:57.967146    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk6pg\" (UniqueName: \"kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.025822 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.025801    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:58.061772 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.061753    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:29:58.068426 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.068404    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.068519 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.068480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.068519 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.068514    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk6pg\" (UniqueName: \"kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.068607 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:58.068532    2578 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-serving-cert: secret "maas-api-e2e-shared-b-19ef0f-serving-cert" not found
Jul 09 15:29:58.068607 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:29:58.068591    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls podName:a55a3de0-7240-4006-ba03-42237fc37e5f nodeName:}" failed. No retries permitted until 2026-07-09 15:29:58.568576706 +0000 UTC m=+2088.983761760 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls") pod "maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" (UID: "a55a3de0-7240-4006-ba03-42237fc37e5f") : secret "maas-api-e2e-shared-b-19ef0f-serving-cert" not found
Jul 09 15:29:58.069158 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.069138    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.089565 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.089540    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk6pg\" (UniqueName: \"kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.240163 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.240134    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:58.573924 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.573829    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.576391 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.576359    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:58.576833 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.576812    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") pod \"maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.688802 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.688755    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:29:58.853142 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.853069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:29:58.992130 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:58.992104    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:29:58.993883 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:29:58.993851    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda55a3de0_7240_4006_ba03_42237fc37e5f.slice/crio-d9f75106cf919980bbf9b98d8df8f61cbdf341b3a457e0627288e382c11078aa WatchSource:0}: Error finding container d9f75106cf919980bbf9b98d8df8f61cbdf341b3a457e0627288e382c11078aa: Status 404 returned error can't find the container with id d9f75106cf919980bbf9b98d8df8f61cbdf341b3a457e0627288e382c11078aa
Jul 09 15:29:59.093649 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:29:59.093620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" event={"ID":"a55a3de0-7240-4006-ba03-42237fc37e5f","Type":"ContainerStarted","Data":"d9f75106cf919980bbf9b98d8df8f61cbdf341b3a457e0627288e382c11078aa"}
Jul 09 15:30:00.153400 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.153299    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:00.158651 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.158628    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:30:00.158777 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.158741    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:00.162355 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.162338    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:30:00.172623 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.172596    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:00.179334 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.179310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:30:00.291439 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.291405    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gpxpw\" (UniqueName: \"kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw\") pod \"maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5\" (UID: \"187443d0-dcbb-44c4-96c5-a47ba7d9d17e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:00.291630 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.291606    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcwnt\" (UniqueName: \"kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt\") pod \"maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt\" (UID: \"9262b4c2-d5e0-4c16-ad06-fb4a73168285\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:30:00.392098 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.392020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcwnt\" (UniqueName: \"kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt\") pod \"maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt\" (UID: \"9262b4c2-d5e0-4c16-ad06-fb4a73168285\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:30:00.392098 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.392061    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gpxpw\" (UniqueName: \"kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw\") pod \"maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5\" (UID: \"187443d0-dcbb-44c4-96c5-a47ba7d9d17e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:00.409260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.409232    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gpxpw\" (UniqueName: \"kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw\") pod \"maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5\" (UID: \"187443d0-dcbb-44c4-96c5-a47ba7d9d17e\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:00.409380 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.409255    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcwnt\" (UniqueName: \"kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt\") pod \"maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt\" (UID: \"9262b4c2-d5e0-4c16-ad06-fb4a73168285\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:30:00.470525 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.470497    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:00.478400 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.478379    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:30:00.618714 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.618686    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:00.620056 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:30:00.620027    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod187443d0_dcbb_44c4_96c5_a47ba7d9d17e.slice/crio-c49c71312690fb705084a474a3a03ec4d69df65847b66f7bfb07bf228fd48e32 WatchSource:0}: Error finding container c49c71312690fb705084a474a3a03ec4d69df65847b66f7bfb07bf228fd48e32: Status 404 returned error can't find the container with id c49c71312690fb705084a474a3a03ec4d69df65847b66f7bfb07bf228fd48e32
Jul 09 15:30:00.845231 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:00.845204    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:30:00.846293 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:30:00.846263    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9262b4c2_d5e0_4c16_ad06_fb4a73168285.slice/crio-69d88ca6459cc46cd6e312bd6b4e049d2929314cdd92f1e8c3daa0acd6d14e4d WatchSource:0}: Error finding container 69d88ca6459cc46cd6e312bd6b4e049d2929314cdd92f1e8c3daa0acd6d14e4d: Status 404 returned error can't find the container with id 69d88ca6459cc46cd6e312bd6b4e049d2929314cdd92f1e8c3daa0acd6d14e4d
Jul 09 15:30:01.105667 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.105636    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" event={"ID":"a55a3de0-7240-4006-ba03-42237fc37e5f","Type":"ContainerStarted","Data":"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"}
Jul 09 15:30:01.105796 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.105715    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:30:01.107186 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.107159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" event={"ID":"9262b4c2-d5e0-4c16-ad06-fb4a73168285","Type":"ContainerStarted","Data":"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"}
Jul 09 15:30:01.107287 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.107205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" event={"ID":"9262b4c2-d5e0-4c16-ad06-fb4a73168285","Type":"ContainerStarted","Data":"69d88ca6459cc46cd6e312bd6b4e049d2929314cdd92f1e8c3daa0acd6d14e4d"}
Jul 09 15:30:01.108573 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.108555    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerStarted","Data":"a015accd4265c27065f4d7aa4a40ebf01ada4f2f4fe7109255fd0964a279af88"}
Jul 09 15:30:01.108644 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.108588    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerStarted","Data":"c49c71312690fb705084a474a3a03ec4d69df65847b66f7bfb07bf228fd48e32"}
Jul 09 15:30:01.126201 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.126152    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" podStartSLOduration=3.012713343 podStartE2EDuration="4.126137047s" totalImagesPullingTime="1.113423704s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.123768814 +0000 UTC m=+2091.538953899" watchObservedRunningTime="2026-07-09 15:30:01.126137047 +0000 UTC m=+2091.541322122"
Jul 09 15:30:01.140936 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.140893    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" podStartSLOduration=1.140879491 podStartE2EDuration="1.140879491s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.139582113 +0000 UTC m=+2091.554767189" watchObservedRunningTime="2026-07-09 15:30:01.140879491 +0000 UTC m=+2091.556064567"
Jul 09 15:30:01.158252 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:01.158207    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" podStartSLOduration=1.15819488 podStartE2EDuration="1.15819488s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.156652181 +0000 UTC m=+2091.571837257" watchObservedRunningTime="2026-07-09 15:30:01.15819488 +0000 UTC m=+2091.573380133"
Jul 09 15:30:02.116054 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:02.116019    2578 generic.go:356] "Generic (PLEG): container finished" podID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerID="a015accd4265c27065f4d7aa4a40ebf01ada4f2f4fe7109255fd0964a279af88" exitCode=7
Jul 09 15:30:02.116223 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:02.116159    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerDied","Data":"a015accd4265c27065f4d7aa4a40ebf01ada4f2f4fe7109255fd0964a279af88"}
Jul 09 15:30:02.116338 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:02.116322    2578 scope.go:117] "RemoveContainer" containerID="a015accd4265c27065f4d7aa4a40ebf01ada4f2f4fe7109255fd0964a279af88"
Jul 09 15:30:02.368946 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:02.368867    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:03.123149 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:03.123119    2578 generic.go:356] "Generic (PLEG): container finished" podID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerID="a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef" exitCode=7
Jul 09 15:30:03.123322 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:03.123205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerDied","Data":"a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef"}
Jul 09 15:30:03.123322 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:03.123257    2578 scope.go:117] "RemoveContainer" containerID="a015accd4265c27065f4d7aa4a40ebf01ada4f2f4fe7109255fd0964a279af88"
Jul 09 15:30:03.123454 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:03.123437    2578 scope.go:117] "RemoveContainer" containerID="a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef"
Jul 09 15:30:03.123629 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:30:03.123606    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5_odh-ai-gateway-infra(187443d0-dcbb-44c4-96c5-a47ba7d9d17e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e"
Jul 09 15:30:04.129872 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:04.129839    2578 scope.go:117] "RemoveContainer" containerID="a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef"
Jul 09 15:30:04.130367 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:30:04.130103    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"cleanup\" with CrashLoopBackOff: \"back-off 10s restarting failed container=cleanup pod=maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5_odh-ai-gateway-infra(187443d0-dcbb-44c4-96c5-a47ba7d9d17e)\"" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e"
Jul 09 15:30:07.121602 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:07.121569    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:30:10.235642 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:10.235613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:30:10.242227 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:10.242206    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:30:10.976823 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:10.976786    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:11.090257 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:11.090226    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:17.117631 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:17.117602    2578 scope.go:117] "RemoveContainer" containerID="a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef"
Jul 09 15:30:18.208646 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:18.208606    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerStarted","Data":"b9e30070f64a7fc915a9cf4fccb5d518cb50eb24cec25c8de277ee978c9061d5"}
Jul 09 15:30:19.258495 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:19.258466    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:19.258956 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:19.258632    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup" containerID="cri-o://b9e30070f64a7fc915a9cf4fccb5d518cb50eb24cec25c8de277ee978c9061d5" gracePeriod=30
Jul 09 15:30:19.641775 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:19.641672    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:19.732304 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:19.732273    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:24.718373 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:24.718337    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:24.821925 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:24.821896    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:30:49.378966 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.378933    2578 generic.go:356] "Generic (PLEG): container finished" podID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerID="b9e30070f64a7fc915a9cf4fccb5d518cb50eb24cec25c8de277ee978c9061d5" exitCode=137
Jul 09 15:30:49.379399 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.379019    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerDied","Data":"b9e30070f64a7fc915a9cf4fccb5d518cb50eb24cec25c8de277ee978c9061d5"}
Jul 09 15:30:49.379399 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.379083    2578 scope.go:117] "RemoveContainer" containerID="a562dc60f4528c3fe6d09a1bf705b7245dcf227685c429262fd3ab41bb154eef"
Jul 09 15:30:49.443108 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.443088    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:49.519131 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.519051    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gpxpw\" (UniqueName: \"kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw\") pod \"187443d0-dcbb-44c4-96c5-a47ba7d9d17e\" (UID: \"187443d0-dcbb-44c4-96c5-a47ba7d9d17e\") "
Jul 09 15:30:49.521258 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.521230    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw" (OuterVolumeSpecName: "kube-api-access-gpxpw") pod "187443d0-dcbb-44c4-96c5-a47ba7d9d17e" (UID: "187443d0-dcbb-44c4-96c5-a47ba7d9d17e"). InnerVolumeSpecName "kube-api-access-gpxpw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:30:49.620318 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:49.620286    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gpxpw\" (UniqueName: \"kubernetes.io/projected/187443d0-dcbb-44c4-96c5-a47ba7d9d17e-kube-api-access-gpxpw\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:30:50.385748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:50.385657    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"
Jul 09 15:30:50.385748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:50.385661    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5" event={"ID":"187443d0-dcbb-44c4-96c5-a47ba7d9d17e","Type":"ContainerDied","Data":"c49c71312690fb705084a474a3a03ec4d69df65847b66f7bfb07bf228fd48e32"}
Jul 09 15:30:50.385748 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:50.385725    2578 scope.go:117] "RemoveContainer" containerID="b9e30070f64a7fc915a9cf4fccb5d518cb50eb24cec25c8de277ee978c9061d5"
Jul 09 15:30:50.406173 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:50.406149    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:50.410906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:50.410882    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-19ef0f-29726850-bpbc5"]
Jul 09 15:30:52.123758 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:30:52.123719    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" path="/var/lib/kubelet/pods/187443d0-dcbb-44c4-96c5-a47ba7d9d17e/volumes"
Jul 09 15:31:00.015085 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:00.015050    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:31:00.015527 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:00.015247    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" podUID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" containerName="cleanup" containerID="cri-o://5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087" gracePeriod=30
Jul 09 15:31:30.217937 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.217908    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:31:30.280087 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.280018    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dcwnt\" (UniqueName: \"kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt\") pod \"9262b4c2-d5e0-4c16-ad06-fb4a73168285\" (UID: \"9262b4c2-d5e0-4c16-ad06-fb4a73168285\") "
Jul 09 15:31:30.282217 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.282193    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt" (OuterVolumeSpecName: "kube-api-access-dcwnt") pod "9262b4c2-d5e0-4c16-ad06-fb4a73168285" (UID: "9262b4c2-d5e0-4c16-ad06-fb4a73168285"). InnerVolumeSpecName "kube-api-access-dcwnt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:31:30.380866 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.380834    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dcwnt\" (UniqueName: \"kubernetes.io/projected/9262b4c2-d5e0-4c16-ad06-fb4a73168285-kube-api-access-dcwnt\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:31:30.611229 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.611145    2578 generic.go:356] "Generic (PLEG): container finished" podID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" containerID="5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087" exitCode=137
Jul 09 15:31:30.611229 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.611196    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"
Jul 09 15:31:30.611409 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.611195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" event={"ID":"9262b4c2-d5e0-4c16-ad06-fb4a73168285","Type":"ContainerDied","Data":"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"}
Jul 09 15:31:30.611409 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.611325    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt" event={"ID":"9262b4c2-d5e0-4c16-ad06-fb4a73168285","Type":"ContainerDied","Data":"69d88ca6459cc46cd6e312bd6b4e049d2929314cdd92f1e8c3daa0acd6d14e4d"}
Jul 09 15:31:30.611409 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.611357    2578 scope.go:117] "RemoveContainer" containerID="5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"
Jul 09 15:31:30.621078 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.621060    2578 scope.go:117] "RemoveContainer" containerID="5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"
Jul 09 15:31:30.621299 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:31:30.621279    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087\": container with ID starting with 5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087 not found: ID does not exist" containerID="5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"
Jul 09 15:31:30.621346 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.621308    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087"} err="failed to get container status \"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087\": rpc error: code = NotFound desc = could not find container \"5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087\": container with ID starting with 5181fdcc84832408ded2990e4c2e543062bfe5f9610ed8069b0019772ad22087 not found: ID does not exist"
Jul 09 15:31:30.639324 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.639285    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:31:30.642267 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:30.642247    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-df6252-29726850-nzszt"]
Jul 09 15:31:32.124239 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:31:32.124205    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" path="/var/lib/kubelet/pods/9262b4c2-d5e0-4c16-ad06-fb4a73168285/volumes"
Jul 09 15:33:07.511906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:07.511820    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:08.254487 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.254453    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:33:08.254764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.254729    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" podUID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" containerName="maas-api" containerID="cri-o://b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac" gracePeriod=30
Jul 09 15:33:08.513519 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.513458    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:33:08.542114 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.541065    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2pm45\" (UniqueName: \"kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45\") pod \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") "
Jul 09 15:33:08.542114 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.541175    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") pod \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") "
Jul 09 15:33:08.542114 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.542085    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca\") pod \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\" (UID: \"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a\") "
Jul 09 15:33:08.544100 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.542963    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" (UID: "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:33:08.549926 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.549894    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45" (OuterVolumeSpecName: "kube-api-access-2pm45") pod "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" (UID: "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a"). InnerVolumeSpecName "kube-api-access-2pm45". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:33:08.550607 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.550578    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" (UID: "1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:33:08.643938 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.643915    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:08.643938 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.643937    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2pm45\" (UniqueName: \"kubernetes.io/projected/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-kube-api-access-2pm45\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:08.644099 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.643946    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:08.822014 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:08.821920    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:09.135679 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.135598    2578 generic.go:356] "Generic (PLEG): container finished" podID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" containerID="b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac" exitCode=0
Jul 09 15:33:09.135679 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.135657    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"
Jul 09 15:33:09.135854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.135689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" event={"ID":"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a","Type":"ContainerDied","Data":"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"}
Jul 09 15:33:09.135854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.135733    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf" event={"ID":"1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a","Type":"ContainerDied","Data":"687d1bbe156a0780c01e6ad925fd1ee7888c0e4548b549ad8dc611cf0b4e48d7"}
Jul 09 15:33:09.135854 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.135757    2578 scope.go:117] "RemoveContainer" containerID="b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"
Jul 09 15:33:09.145840 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.145824    2578 scope.go:117] "RemoveContainer" containerID="b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"
Jul 09 15:33:09.146107 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:33:09.146085    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac\": container with ID starting with b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac not found: ID does not exist" containerID="b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"
Jul 09 15:33:09.146208 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.146113    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac"} err="failed to get container status \"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac\": rpc error: code = NotFound desc = could not find container \"b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac\": container with ID starting with b7306c6433fb8460b97228b8cc6c64ba281b36b2b6d2496e552a14f86f686dac not found: ID does not exist"
Jul 09 15:33:09.160816 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.160792    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:33:09.167110 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:09.167086    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-df6252-f54497fb7-mxgtf"]
Jul 09 15:33:10.124357 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:10.124323    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" path="/var/lib/kubelet/pods/1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a/volumes"
Jul 09 15:33:14.272844 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:14.272809    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:14.369622 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:14.369591    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:14.710938 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:14.710900    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:15.004614 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.004521    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:15.506642 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.506616    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:15.648429 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.648391    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:15.748376 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.748344    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:15.922192 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.922115    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:33:15.922385 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.922361    2578 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" podUID="a55a3de0-7240-4006-ba03-42237fc37e5f" containerName="maas-api" containerID="cri-o://09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5" gracePeriod=30
Jul 09 15:33:15.947558 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:15.947531    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:16.164604 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.164580    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:33:16.173595 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.173535    2578 generic.go:356] "Generic (PLEG): container finished" podID="a55a3de0-7240-4006-ba03-42237fc37e5f" containerID="09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5" exitCode=0
Jul 09 15:33:16.173595 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.173573    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" event={"ID":"a55a3de0-7240-4006-ba03-42237fc37e5f","Type":"ContainerDied","Data":"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"}
Jul 09 15:33:16.173595 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.173580    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"
Jul 09 15:33:16.173785 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.173612    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8" event={"ID":"a55a3de0-7240-4006-ba03-42237fc37e5f","Type":"ContainerDied","Data":"d9f75106cf919980bbf9b98d8df8f61cbdf341b3a457e0627288e382c11078aa"}
Jul 09 15:33:16.173785 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.173636    2578 scope.go:117] "RemoveContainer" containerID="09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"
Jul 09 15:33:16.184976 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.184959    2578 scope.go:117] "RemoveContainer" containerID="09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"
Jul 09 15:33:16.185297 ip-10-0-129-1 kubenswrapper[2578]: E0709 15:33:16.185272    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5\": container with ID starting with 09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5 not found: ID does not exist" containerID="09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"
Jul 09 15:33:16.185392 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.185301    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5"} err="failed to get container status \"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5\": rpc error: code = NotFound desc = could not find container \"09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5\": container with ID starting with 09ef38da023d7e5b749385d4e9e4164fdaf97c20cd5c3c1378fb66b647e2e6d5 not found: ID does not exist"
Jul 09 15:33:16.212404 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.212373    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") pod \"a55a3de0-7240-4006-ba03-42237fc37e5f\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") "
Jul 09 15:33:16.212527 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.212448    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wk6pg\" (UniqueName: \"kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg\") pod \"a55a3de0-7240-4006-ba03-42237fc37e5f\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") "
Jul 09 15:33:16.212592 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.212557    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca\") pod \"a55a3de0-7240-4006-ba03-42237fc37e5f\" (UID: \"a55a3de0-7240-4006-ba03-42237fc37e5f\") "
Jul 09 15:33:16.212952 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.212906    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a55a3de0-7240-4006-ba03-42237fc37e5f" (UID: "a55a3de0-7240-4006-ba03-42237fc37e5f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 09 15:33:16.214666 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.214641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg" (OuterVolumeSpecName: "kube-api-access-wk6pg") pod "a55a3de0-7240-4006-ba03-42237fc37e5f" (UID: "a55a3de0-7240-4006-ba03-42237fc37e5f"). InnerVolumeSpecName "kube-api-access-wk6pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 09 15:33:16.214753 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.214641    2578 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a55a3de0-7240-4006-ba03-42237fc37e5f" (UID: "a55a3de0-7240-4006-ba03-42237fc37e5f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 09 15:33:16.313359 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.313333    2578 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a55a3de0-7240-4006-ba03-42237fc37e5f-openshift-service-ca\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:16.313359 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.313357    2578 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a55a3de0-7240-4006-ba03-42237fc37e5f-maas-api-tls\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:16.313501 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.313366    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wk6pg\" (UniqueName: \"kubernetes.io/projected/a55a3de0-7240-4006-ba03-42237fc37e5f-kube-api-access-wk6pg\") on node \"ip-10-0-129-1.ec2.internal\" DevicePath \"\""
Jul 09 15:33:16.497807 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.497775    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:33:16.510750 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:16.510724    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-19ef0f-67488f4cd8-p57j8"]
Jul 09 15:33:18.124101 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:18.124065    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a55a3de0-7240-4006-ba03-42237fc37e5f" path="/var/lib/kubelet/pods/a55a3de0-7240-4006-ba03-42237fc37e5f/volumes"
Jul 09 15:33:21.679545 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:21.679508    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:21.749935 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:21.749902    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:21.986813 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:21.986766    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:27.839552 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:27.839519    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-848487dc69-s8ffz_bf09f557-a978-4e6b-913d-7deb50c81cdb/manager/0.log"
Jul 09 15:33:28.458236 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:28.458202    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk_def60588-6b0b-4d08-aa99-271ec9491303/copy-manifests/0.log"
Jul 09 15:33:28.478346 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:28.478249    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk_def60588-6b0b-4d08-aa99-271ec9491303/manager/0.log"
Jul 09 15:33:29.286821 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.286788    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/util/0.log"
Jul 09 15:33:29.294904 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.294874    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/pull/0.log"
Jul 09 15:33:29.302393 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.302374    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/extract/0.log"
Jul 09 15:33:29.421503 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.421477    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/util/0.log"
Jul 09 15:33:29.429323 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.429298    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/pull/0.log"
Jul 09 15:33:29.437092 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.437072    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/extract/0.log"
Jul 09 15:33:29.559555 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.559479    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/extract/0.log"
Jul 09 15:33:29.568640 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.568613    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/util/0.log"
Jul 09 15:33:29.575568 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.575545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/pull/0.log"
Jul 09 15:33:29.698280 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.698258    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/util/0.log"
Jul 09 15:33:29.707539 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.707519    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/pull/0.log"
Jul 09 15:33:29.716593 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:29.716574    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/extract/0.log"
Jul 09 15:33:31.261607 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:31.261575    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgff5_99e9f74e-b382-47f0-8ab6-590a12b4d7b5/discovery/0.log"
Jul 09 15:33:31.901386 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:31.901351    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4gmm5_3bb5abcc-72e6-4bc2-865f-268fac0f626f/payload-processing/0.log"
Jul 09 15:33:32.396390 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:32.396359    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-d6qlf_1c7b4b10-22f4-47a9-956d-af101248df95/main/0.log"
Jul 09 15:33:32.530091 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:32.530059    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-mvrcv_03805c69-89b1-45c7-8a6a-7d1d2a374e2b/main/0.log"
Jul 09 15:33:37.845160 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:37.845097    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:37.922789 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:37.922760    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:41.277388 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:41.277346    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-k6swk_d38b4155-289f-46f0-944a-35d04d5e9631/global-pull-secret-syncer/0.log"
Jul 09 15:33:41.356436 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:41.356410    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log"
Jul 09 15:33:41.534665 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:41.534574    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-129-1.ec2.internal_caf9e1426bf7d6e6ee3881921c5dfd0e/haproxy/0.log"
Jul 09 15:33:45.608302 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.608269    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/extract/0.log"
Jul 09 15:33:45.659045 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.658984    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/util/0.log"
Jul 09 15:33:45.686764 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.686735    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759t85gn_16f3b5dc-cf9f-49ef-bc01-108f2649e729/pull/0.log"
Jul 09 15:33:45.728866 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.728835    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/extract/0.log"
Jul 09 15:33:45.764925 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.764908    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/util/0.log"
Jul 09 15:33:45.792594 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.792567    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0xjh8j_fa4e75fb-b96a-4df0-a6be-cecedb9f8813/pull/0.log"
Jul 09 15:33:45.825190 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.825170    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/extract/0.log"
Jul 09 15:33:45.849349 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.849324    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/util/0.log"
Jul 09 15:33:45.879955 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.879876    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed739kzzx_622361bd-f492-4515-910c-2f070348acc9/pull/0.log"
Jul 09 15:33:45.916119 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.916096    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/extract/0.log"
Jul 09 15:33:45.941864 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.941845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/util/0.log"
Jul 09 15:33:45.973565 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:45.973545    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef177k8s_ed16122f-7a14-416d-8b16-1c4c232e6a09/pull/0.log"
Jul 09 15:33:48.712075 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.712042    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/alertmanager/0.log"
Jul 09 15:33:48.745715 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.745686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/config-reloader/0.log"
Jul 09 15:33:48.777287 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.777264    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/kube-rbac-proxy-web/0.log"
Jul 09 15:33:48.809941 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.809915    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/kube-rbac-proxy/0.log"
Jul 09 15:33:48.844500 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.844474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/kube-rbac-proxy-metric/0.log"
Jul 09 15:33:48.867467 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.867405    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/prom-label-proxy/0.log"
Jul 09 15:33:48.893806 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.893781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_906d9488-d716-4b74-9448-dc14640604b2/init-config-reloader/0.log"
Jul 09 15:33:48.948199 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:48.948170    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-cd665_1e2df791-0ddf-41d0-a89e-800064af51fd/cluster-monitoring-operator/0.log"
Jul 09 15:33:49.069705 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.069677    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-57d9fdfb9c-8xtjj_267c4f2a-b28d-4167-8791-2fd03e8d93ae/metrics-server/0.log"
Jul 09 15:33:49.237726 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.237705    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpqgz_c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e/node-exporter/0.log"
Jul 09 15:33:49.262171 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.262155    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpqgz_c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e/kube-rbac-proxy/0.log"
Jul 09 15:33:49.297239 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.297222    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-dpqgz_c1bfe0f2-b1ea-4f77-ab3d-1e359744dc2e/init-textfile/0.log"
Jul 09 15:33:49.548320 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.548254    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bczpn_437e409a-1b16-49fc-a90b-4c2ac754f06e/kube-rbac-proxy-main/0.log"
Jul 09 15:33:49.572506 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.572482    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bczpn_437e409a-1b16-49fc-a90b-4c2ac754f06e/kube-rbac-proxy-self/0.log"
Jul 09 15:33:49.602113 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.602091    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-bczpn_437e409a-1b16-49fc-a90b-4c2ac754f06e/openshift-state-metrics/0.log"
Jul 09 15:33:49.956669 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.956647    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677b6c4997-7j8cw_20cd8011-2ad6-4627-b9d3-a4fcbe413562/telemeter-client/0.log"
Jul 09 15:33:49.988933 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:49.988907    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677b6c4997-7j8cw_20cd8011-2ad6-4627-b9d3-a4fcbe413562/reload/0.log"
Jul 09 15:33:50.017396 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:50.017373    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677b6c4997-7j8cw_20cd8011-2ad6-4627-b9d3-a4fcbe413562/kube-rbac-proxy/0.log"
Jul 09 15:33:51.693416 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.693377    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"]
Jul 09 15:33:51.693951 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.693931    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a55a3de0-7240-4006-ba03-42237fc37e5f" containerName="maas-api"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.693956    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a55a3de0-7240-4006-ba03-42237fc37e5f" containerName="maas-api"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.693967    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.693976    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694017    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" containerName="maas-api"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694026    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" containerName="maas-api"
Jul 09 15:33:51.694042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694036    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694046    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694063    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694072    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694186    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ca2e9af-715c-4cb9-8cd9-6f2f8b77582a" containerName="maas-api"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694197    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a55a3de0-7240-4006-ba03-42237fc37e5f" containerName="maas-api"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694206    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694216    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694224    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="187443d0-dcbb-44c4-96c5-a47ba7d9d17e" containerName="cleanup"
Jul 09 15:33:51.694260 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.694234    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9262b4c2-d5e0-4c16-ad06-fb4a73168285" containerName="cleanup"
Jul 09 15:33:51.697835 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.697814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.700809 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.700783    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8k5dp\"/\"default-dockercfg-ftn9x\""
Jul 09 15:33:51.701943 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.701924    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k5dp\"/\"kube-root-ca.crt\""
Jul 09 15:33:51.702084 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.701965    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8k5dp\"/\"openshift-service-ca.crt\""
Jul 09 15:33:51.709715 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.709688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"]
Jul 09 15:33:51.715905 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.715881    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-sys\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.716042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.715912    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h26w9\" (UniqueName: \"kubernetes.io/projected/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-kube-api-access-h26w9\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.716042 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.715938    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-podres\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.716123 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.716075    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-lib-modules\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.716233 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.716211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-proc\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817495 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817459    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-sys\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817691 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817499    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h26w9\" (UniqueName: \"kubernetes.io/projected/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-kube-api-access-h26w9\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817691 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-podres\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817691 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-lib-modules\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817691 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817591    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-sys\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817846 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817704    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-proc\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817846 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817712    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-podres\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817846 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817720    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-lib-modules\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.817846 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.817775    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-proc\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:51.826772 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:51.826747    2578 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h26w9\" (UniqueName: \"kubernetes.io/projected/229baf3b-d2df-42d5-a6fd-01a41a02cfc4-kube-api-access-h26w9\") pod \"perf-node-gather-daemonset-kl6zr\" (UID: \"229baf3b-d2df-42d5-a6fd-01a41a02cfc4\") " pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:52.008875 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.008840    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:52.144977 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.144950    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"]
Jul 09 15:33:52.146509 ip-10-0-129-1 kubenswrapper[2578]: W0709 15:33:52.146480    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod229baf3b_d2df_42d5_a6fd_01a41a02cfc4.slice/crio-66b48b7137647d6de77a420a259ed852b36860a587722ec8ae743b402eb32513 WatchSource:0}: Error finding container 66b48b7137647d6de77a420a259ed852b36860a587722ec8ae743b402eb32513: Status 404 returned error can't find the container with id 66b48b7137647d6de77a420a259ed852b36860a587722ec8ae743b402eb32513
Jul 09 15:33:52.200906 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.200845    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/1.log"
Jul 09 15:33:52.211241 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.211212    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-pmmtx_6c290e4a-1ef9-497e-8cd6-508247c38320/console-operator/2.log"
Jul 09 15:33:52.366759 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.366665    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr" event={"ID":"229baf3b-d2df-42d5-a6fd-01a41a02cfc4","Type":"ContainerStarted","Data":"1df1bf7d328ce847fd3f6cc021c476d7939a15ede8f5210454aa23df868f8df9"}
Jul 09 15:33:52.366759 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.366727    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr" event={"ID":"229baf3b-d2df-42d5-a6fd-01a41a02cfc4","Type":"ContainerStarted","Data":"66b48b7137647d6de77a420a259ed852b36860a587722ec8ae743b402eb32513"}
Jul 09 15:33:52.366759 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.366752    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:52.386530 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.386472    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr" podStartSLOduration=1.38645131 podStartE2EDuration="1.38645131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:33:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:33:52.383710868 +0000 UTC m=+2322.798895946" watchObservedRunningTime="2026-07-09 15:33:52.38645131 +0000 UTC m=+2322.801636384"
Jul 09 15:33:52.692402 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:52.692322    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-55569d976b-zw8hh_2eba0a8f-e125-45d3-87db-53738a792556/console/0.log"
Jul 09 15:33:54.201169 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:54.201131    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:33:54.462163 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:54.462070    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5c747_f67f283a-3d39-4c54-9e36-aa5446a36d43/dns/0.log"
Jul 09 15:33:54.486153 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:54.486128    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5c747_f67f283a-3d39-4c54-9e36-aa5446a36d43/kube-rbac-proxy/0.log"
Jul 09 15:33:54.672720 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:54.672693    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hbxb5_ed9a78e5-6aab-4010-8d11-2e653d030f2c/dns-node-resolver/0.log"
Jul 09 15:33:55.294036 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:55.293979    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-58bd7b847d-55k72_16403a6e-dbba-4e5a-b02e-40c6dd5783af/registry/0.log"
Jul 09 15:33:55.320732 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:55.320701    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-fzfxb_f633027c-66fd-4326-9488-ef6da09462bd/node-ca/0.log"
Jul 09 15:33:56.575797 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:56.575761    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgff5_99e9f74e-b382-47f0-8ab6-590a12b4d7b5/discovery/0.log"
Jul 09 15:33:56.856145 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:56.856065    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4gmm5_3bb5abcc-72e6-4bc2-865f-268fac0f626f/payload-processing/0.log"
Jul 09 15:33:57.688032 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:57.688001    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rvjs9_f354196a-c26a-46f1-ac17-56565debaa7f/serve-healthcheck-canary/0.log"
Jul 09 15:33:58.288696 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:58.288667    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvsqx_bd011838-6e44-44ff-8f1e-d7c8acaed378/kube-rbac-proxy/0.log"
Jul 09 15:33:58.319307 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:58.319278    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvsqx_bd011838-6e44-44ff-8f1e-d7c8acaed378/exporter/0.log"
Jul 09 15:33:58.346353 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:58.346319    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-tvsqx_bd011838-6e44-44ff-8f1e-d7c8acaed378/extractor/0.log"
Jul 09 15:33:58.384686 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:58.384663    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8k5dp/perf-node-gather-daemonset-kl6zr"
Jul 09 15:33:58.910425 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:33:58.910398    2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2ljtt_94224c1b-197b-4e14-9585-802eebd128c6/konnectivity-agent/0.log" limit=1024
Jul 09 15:34:01.305690 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:01.305650    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-848487dc69-s8ffz_bf09f557-a978-4e6b-913d-7deb50c81cdb/manager/0.log"
Jul 09 15:34:01.684712 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:01.684636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk_def60588-6b0b-4d08-aa99-271ec9491303/manager/0.log"
Jul 09 15:34:01.701958 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:01.701937    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6fc7dfbfc4-vcdwk_def60588-6b0b-4d08-aa99-271ec9491303/copy-manifests/0.log"
Jul 09 15:34:02.835731 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:02.835686    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgff5_99e9f74e-b382-47f0-8ab6-590a12b4d7b5/discovery/0.log"
Jul 09 15:34:02.955556 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:02.955521    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6c4bdcff7c-nrl8g_cf79891a-f608-45aa-80eb-8bb0d5def556/manager/0.log"
Jul 09 15:34:03.053103 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:03.053021    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4gmm5_3bb5abcc-72e6-4bc2-865f-268fac0f626f/payload-processing/0.log"
Jul 09 15:34:04.636683 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:04.636653    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-qgff5_99e9f74e-b382-47f0-8ab6-590a12b4d7b5/discovery/0.log"
Jul 09 15:34:04.902513 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:04.902440    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-4gmm5_3bb5abcc-72e6-4bc2-865f-268fac0f626f/payload-processing/0.log"
Jul 09 15:34:08.682814 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:08.682776    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-lxxwm_05e9f598-7b09-4fbf-9c95-89538b912e0a/migrator/0.log"
Jul 09 15:34:08.711451 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:08.711429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-lxxwm_05e9f598-7b09-4fbf-9c95-89538b912e0a/graceful-termination/0.log"
Jul 09 15:34:09.134826 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:09.134792    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-l6cnd_8790cd51-fa0c-45f5-8c68-3a04310bb53d/kube-storage-version-migrator-operator/1.log"
Jul 09 15:34:09.136306 ip-10-0-129-1 kubenswrapper[2578]: I0709 15:34:09.136282    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-l6cnd_8790cd51-fa0c-45f5-8c68-3a04310bb53d/kube-storage-version-migrator-operator/0.log"